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^ (57) Abstract: A computer editing system for editing and creating a multimedia program in a visual workspace (1), which provides 
^ a plurality of segments of audio or video data, displays an icon (10) representing each of the segments, associates a firet one of the 
O segments (2) with at least one other of the segments, displays an indication of the association of the first to the other of the segments. 
^ thereby composing a program of the segments, wherein the program may be played in a sequence determined by a user in accordance 
with the associations. 
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For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
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METHOD AND APPARATUS FOR OBJECT 
ORIENTED MULTIMEDIA EDITING 



A portion of the disclosure of this patent document contains material which is subject to 
copyright protection. The copyright owner has no objection to the facsimile reproduction by 
anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark 
Office patent files or records, but otherwise reserves all copyright rights whatsoever. 

A computer program listing Appendix that includes a software program code executable 
on computer as described below is part of this application. 

FIELD OF INVENTION 

The present invention relates to a method and apparatus for editing and creating a 
multimedia program in a visual workspace. 



BACKGROUND 

Computer-based editing systems for video and audio information are well known, and a 
number of such systems are commercially available. These typically allow the user of the 
editing (or production) system, who is referred to as an editor or producer, to create and edit 
programs from segments or clips of video or audio, and which usually also include text and 
graphics material. 

hi addition, it is known to include what are called links or hyperlinks in audio and/or 
video multimedia presentations. These links aUow the viewer or Kstener of the program to jump 
ftom one program segment to another at hisAier election rather than to merely Usten or watch the 
program in a conventional sequential order. Such links are well known in the computer context, 

but are not so limited. 

For instance, see U.S. Patent AppUcation No. 09/320,132, filed May 25. 1999. entitled 
"Playing Audio Of One Kind In Response To User Action While Playing Audio of Another 
Kind", filed by Williaitn J. Loewenttial et al., commonly owned with this appUcation; and also 
see commonly owned U.S. Application No. 09,272,633, filed March 18. 1999. entitled "Program 
Links and Bulletins for Audio Information Device", filed by WilUam J. Loewenlhal et al., all 
incorporated herein by reference in their entireties. The above-referenced appUcations disclose 
use of links between various data files which are programs, or parts of programs, which 
advantageously allow the user to traverse firom one data file to another data file dq)ending in 
some embodiments upon predeteraiined context reflated relationships. This is analogous to the 
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hyperlinks well known in the computer field in, for instance, websites. Here it is used in the 
context of a radio-type audio receiver, and is also adaptable for a television-type receiver 
('Tlayer"). Of course, this requires that the receiver include local storage for storing the program 
contents so that the user can navigate between the program segments. Also, see U.S. Patents No. 
5,406,626; 5,524,051; 5,590,195, all issued to John O. Ryan, and incorporated herein by 
reference in their entireties. 

Hence, while such linked audio programs are known and also, in general, computer 
editing of video and audio programs is known, in the prior art construction of such linked 
programs requires substantial effort even using computer based editing. 

SUMMARY OF THE INVENTION 

The present system allows the producer to more easily produce the programs by allowing 
him/her to make the associations ("links") between and among program segments in a visual 
workspace. The program produced is thereby not unidirectional (sequential in time only). The 
system allows the producer to edit the programs into a program that does not playback Scorn 
beginning to end in a unidirectional (time) line, but rather, a program that has associations that 
allow playback of the produced programs in an order that is determined by the listener (i.e., the 
programs are interactive). Unidirectional editing as described above is known m the prior art 
(see e.g., U.S. Patent No. 5,892,507, Moorby et al., incorporated by reference in its entirety). 
This is a type of editing in which multimedia data can be linked together to be played back in the 
form of a story from beginning to end along a unidirectional (time) line. 

The present system is an improvement on this time-based editing process that producers 
have used in the past. The present system provides a visual workspace, on a single screen, that 
enables the producer to isolate the segments comprising any program, to convert these segments 
into objects, to establish non-linear (multi-dimensional) relationships ("links") between and 
among any number of such objects, and to prepare multimedia programs. The benefits of the 
system over the well-known, time-based editing process include the production of programs 
more quickly, the reduced need for technical expertise on the part of producers, and the 
improvement in the quaUty of programs. 

Hence, there is provided here a system suitable for creating and editing such complex 
linked programs using a graphical user interface which allows easy linking by ordering icons 
depicting the various segments on a screen, and providing on the screen a spatial indication of 
same. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a sample screen of the visual workspace. 

Figure 2 illustrates a linking of objects coded with ttie markup language. 

Figure 3 illustrates a sample view of the composer of FIG. 1, containing header and detail 
content elements. 

Figure 4 illustrates a sample of a "Player" interface on a general purpose computer that 
can be used in conjunction with this invention to play the produced program. 

Figure 5 illustrates a flowchart of the production of a program using the present system. 

DETAILED DESCRIPTION 

According to an embodiment of the present invention, multimedia programs are created 
and edited (collectively "produced") using computer software that allows multimedia content 
(e.g., audio, video, text, graphics) to be displayed as objects on a screen associated with a 
computer. A simple-to-use visual workspace (graphical user interface) is used to produce 
programs with complex associations. The software runs on, e.g., a standard computer executing 
the Windows 2000 operating system and is coded, e.g., in the C-H- computer language. 

Figure 1 shows a sample screen used interactively by the producer (editor)* who is a 
person. This screen 1 is displayed by the software executed on the computer. Coding this 
software in a suitable language is well within the skill of one of ordinary skiU in the art in light 
of this disclosure. In one embodiment the software is an add-on module to the commercially 
available Multitrack Editor V3.98, part of the DigAS editing system available fiom D.A.V.I.D. 
GmbH of Germany. The producer views the multimedia files 2 or content in the content 
explorer 3. The content explorer 3 is a box on the screen that displays as icons the multimedia 
files 2 (program segments) available to the producer for editing. The producer can choose 
among available multunedia data files to produce programs. The file icons can be 
conventionally dragged and dropped (e.g.. using a mouse associated with the computer) into the 
prompter 4, composer 5, and/or waveform editor 6 portions of the computer screen. The content 
explorer 3 contains icons for multimedia files 2, including audio, video, text and graphics files, 
as well as completed programs. This content (the actual program segments) could come from 
outside sources such as magazine articles, quiz shows, or audio/video sports and traffic updates. 
The content could also come fiom files or records in a computer database. Content is of the type 
available from LAN, local, and remote sources in, e.g., conventional .wav, .txt, .mp3, .jp& and 
.rtf data file formats. 
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The composer 5, as illustrated in Figure 1, provides the producer with a visual workspace 
to produce programs. The composer provides a visual representation of the structural parts of the 
program. The composer has three viewing boxes. In these different boxes, the producer can 
drag and drop multimedia files for viewing or editing. First, there is a multimedia viewer 7, 
which displays the types of files that are contained in each segment 10. Second, there is a 
navigational viewer 8, where the navigational (or multidimensional) structure of the program, or 
the sequence of segments, is created. Third, there is a view box 9, in which the producer can 
view and edit the text or image files without having to open the individual files. 

In the composer 5, die producer can view the segments 10 available for program 
composition. The connposer allows the producer to view and edit segments in the navigational 
viewer 8. The story or content in each segment icon is labeled so that the producer can edit the 
program without having to click each segment icon to determine its contents. There are also 
conventional search mechanisms to find a segment by its label. This is especially necessary for 
larger programs. Each segment 1 0 is conventionally represented by an icon. An unlimited 
number of content elements 1 1 (rectangles) are available in the navigational view 8. When the 
number of content element 1 1 sets reaches the edge of the composer view, the producer is able to 
further view the content element 1 1 sets beyond the edge of the view by conventional scrolUng. 
The properties of the segments 10 in the content elements 11, such as the name or length of the 
segments, can be viewed in a multimedia viewer 7 by suitably selecting a segment. .The 
producer can insert, delete, and/or append segments in the composer 5. The produce can review 
and listen to (or view) the content layers (discussed below) within segments in the composer 5 
using the view box 9 and the waveform editor 6. The producer can exanune segments in any 
order, moving back and forth or up and down between content elements, as illustrated in Fig. 3, 
and as explained in detail below. The producer can also hsten to or view header content 
elements sequentially in the composer. 

The segments 10 are placed in the content elements 11. These content elements are 
shaped like rectangles in the composer's navigational viewer 8. The content elements 11 are 
empty until the producer places segments 10 within the content elements 11. These content 
elements are arranged in levels. Figure 3 shows the arrangement of the content elements into 
header content elements 12 (top level) and detail content elements 13 (lower level). 

The content elements are either prime, meaning they contain only one segment, or are 
compound, meaning they contain more than one segment. A content element may contain any 
number of segments. Figure 1 illustrates examples of a compound content element 14 and a 
prime content element 15, When the content element contains so many segment icons that they 
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are no longer viewable on the screen, the producer can scroll within the content element to see 
the multiple icon segments in the content element on the screen at the same time. The producer 
creates the associations between and among these segments, which here include associations 
other than merely sequential in time. 

As seen in Figure 3, one embodiment of the composer provides a "template" that consists 
of content elements for header information of a story and content elements for the details of a 
story. There are three types of programs that can be produced. The most basic type is a one- 
level program. The end user (who ultimately plays the produced program) can determine the 
order this program is played, scanning forward or backwards through segments. A complex type 
of program is a two-level program. A two-level program has (linked) headers and details which 
are both content elements. A header provides, e.g., a short introduction to a story. A detail 
provides, e.g., the body of a story. The content elements (icons) are arranged in a template in the 
composer to make it easier for the producer to make the associations in the program. A template 
can be spatially arranged to have header content elements 12 on the top level and to have detail 
content elements 13 on the lower level of the composer's navigational viewer 8. 

Another complex type of program is a three-level program. (The number of levels is not 
limited.) A template could also be arranged to have a third level of detail content elements. The 
producer uses this third level of detail content elements to arrange segments in the program 
which further relate to the header or details of the story. For example, the third level contains an 
advertisement for the program, along with an option for the end user to make a purchase. In this 
example, the producer could also place a segment with a video clip in the third-level detail 
content element that would play once the end user made the purchase. This Ihird level of content 
elements is associated with either or both of the other two levels of content elements. 

The producer can via the user interface make any number of associations between and 
among the header content elements and detail content elements. For example, a header content 
element could be linked with one or more detail content elements. A producer could link these 
by mtroducing on the screen an expUcit relationship graphic line between the header and each of 
the detail content elements. Alternatively, a producer could make a duplicate header content 
element (using conventional shading or coloring on the icon to indicate it is a duplicate) and 
copy it on the screen to a location above each of the detail content elements that the producer 
intends to be associated with the header content element One detail content element could also 
be shared by (linked to) multiple header content elements using similar linking techniques. 

The prompter 4, as shown in Figure 1 , allows the producer to create text content and open 
an existing text file to put into a program. The prompter 4 is for viewing and editing text. Text 
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can be imported from a text file or word document or composed directly in the prompter 4. The 
prompter 4 can receive files firom the content explorer 3 and from outside applications. The 
prompter 4 allows the producer to mark parts of the text with tags 16 (Figure 3). The producer 
can tag parts of text for re-evaluation later in editing process. The tags 16 will remain in the 
prompter 4 as long as any of these remain in text. When the text is recorded into audio (using, 
for example, conventional text to speech methods), the recorded audio would be automatically 
separated into individual segments based on the tags 16 placed in the text. 

As iUustrated in Figure 1, the visual workspace also contains a conventional audio 
waveform editor 6. The waveform editor 6 allows the producer to edit audio files and segment 
audio programs. 

Segments of multimedia data are conventionally created by the producer. The producer 
places a content layer or multiple content layers of multimedia data in the segments. The 
producer can drag and drop multimedia data files 2 (content) from the content explorer 3 into the 
individual segments that make up a program. Figure 2 illustrates in a chart the content layers 18 
that make up a segment (Figure 2 is for conceptual purposes and is not part of the user interface). 
Each content layer contams multimedia data. Content layers 18 may contain either audio, video, 
text or ^aphics data. 

The editing system also enables the producer to apply differing conventional compression 
techniques to each content layer within each segment. Different contrat may need to be 
compressed at different rates in order to minimize bandwidth consumption in the system. For 
example, if an audio layer contains music and speech, an author using the editing system can 
apply a different compression to the music and the speech. 

After the segments are edited by the producer in the visual workspace by manipulating 
their icons, in one embodiment the segments are coded in a markup language. This is done to 
provide an exportable file using the markup language (ML). MLs are routinely used m this 
context for exportable computer files. Figure 2 illustrates the associations that the maikup 
language allows between the segments. The segments are coded by the ML so that they can be 
represented as objects 17. The objects 17 are segments, coded with the ML. After coding with 
the ML, the segment is an object 17, composed of content layers 18. These objects 17 contain 
the same audio, text, graphics or video content layers 18 that were m the original segments. This 
markup language establishes relationships between and among objects (using well-known 
hyperlinking technology). TTie ML also enables the graphical user interface ("GUr) on the 
associated "Player" to interact with the content layers of the objects. The Player is a receiver 
unit, as described in the above-referenced patent applications, to which an embodimrat of this 
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invention delivers the programs edited by the editing system. The graphical user interface 
depicts a ML multimedia object composed of ML descriptions 19. Thus, the editing system 
allows the producer to assemble a markup language multimedia object from multiple source 
components. 

Once the program is completed, the program can be played in the visual workspace on a 
general purpose computer using a Player application program, or can be played using the 
physical dedicated Player device. The computer requires the Player application to play the 
program. An example of a Player application program interface 20 on a general purpose 
computer is illustrated in Figure 4. The Player interface 20 has a small screen and various 
controls as illustrated. The editor or end user can listen to the header of a story and can listen to 
the details of that story by pressing the ''more info" button 20a on the Player interface 20. For 
example, if the end user is listening to a story about Tiger Woods, and mention of his equipment 
is made in that story, the end user can press the "more info" button 20a on the Player interface 
and hear about the equipment Tiger Woods uses and could also hear an advertisement for this 
equipment and even make a purchase of the advertised equipment The user could also 
simultaneously watch footage of Tiger swinging a golf club in the viewing screen 20b of the 
Player. If the editor or end user does not want to hsten to the details of a story, he can continue 
listening to the default program of continuous header story segments that the producer has 
produced using this invention. Other default programs may be produced; the producer could, for 
example, produce a program that would play the header and each detail of a story even if not 
prompted by the usen The dedicated Player is of the type described above and has similar 
functionality as interface 20. 

The present system allows the producer to more easily produce linked type programs by 
allowing him/her to make the associations between and among program segments in a visual 
workspace. The process of creating associations is made easier because the producer can not 
only arrange the stories in content elements, but can also see the segments and what fliey contain. 
Thus, for example, in a header content element, the producer can see there is a heading segment 
of a story about Tiger Woods winning a tournament, and in the detail content element there is a 
segment about the details of the story about Tiger winning a tournament Further, the producer 
can see that a segment (or segments) in a third-level detail content element contains an 
advertisement for golf clubs in which the end user could, for example, make a purchase or watch 
a video of Tiger using the golf clubs being advertised. 

Figure 5 illustrates a flowchart of the production of a program using the present system. 
First, program content or multimedia data files are stored in a local database 22 associated with 
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the editing computer. The producer uses these files to produce programs in the visual workspace 
21. When production is complete, the programs are saved in the database 22 and notification is 
sent to the ML generator 23 (which is the ML described above). The ML generator 23 retrieves 
the programs from database 22 and codes the program with the markup language. The resulting 
marked-up program is saved in a new database 24 also associated with the editing computer. 
The distribution system 25 is then notified that the program is complete. Distribution system 25 
is, e.g., a wireless broadcast system, such as the system utilized by the Player, as described in the 
above-referenced patent applications. Distribution system 25 can also be, e.g., an internet 
system, such as the system utilized by an internet based version of the Player. In addition, the 
distribution system 25 can be, e.g., a physical data storage media such as Compact Flash, Tape, 
or Compact Disk. Finally, the Player 26 receives content firom the distribution system 25 and 
stores the content in its local database 27. The stored content is then available for interactive 
playback through the Player's 26 graphical user interface. 

The computer program listing Appendix, which is a part of this application, includes a 
description including computer code of the markup language described above, and is entitled 
"CAML: Command Audio Markup Language Specification." The Appendix also includes 
computer code, and descriptions thereof in flie form of comments, to carry out the system in 
accordance with this disclosure. That description is entitled "On-Demand Authoring (ODA) 
Studio Design Specification." 

Having described the embodiments of the invention, it should be apparent to those skilled 
m the art that the foregoing is merely illustrative and not limiting, having been presented as an 
example only. Modifications and other embodiments are withm the scope of one of ordinary 
skill in the art and are contemplated as being within the scope of the invention as defined by the 
following claims. 
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1. CAML Language 
.1. Abstract 



ihe'c^^rAudio Markup Language <CAMLJ is designed to meet the Metadata definition needs of audio-centric interactive 
2!t?S^ di»?rJbu^rLS^rlLss digital audio broadcast (DAB) systems to mobile and «ta*=i««^ ^^fj^' ;f^i<ihtli«. 
90 Metadata, we generally mean data about content, such as the broadcast time of an audio program or that ^hia editi« Of Mightlxn. 
- S^rfiie stlri^s uLno CAML. an author of a CAML document can combine and interrelate multiple audio-centric ""^ia objects 
into com^^lUng pr;«nta?iona. In automobile driver and other 'eyes on the road, bonds on the wheel' ^^Jj^**" 
audio X^rs of the rich media are expected to be available to consumers. Thus, tbe audio-centrirtty of the specification (as 
SJpoLd ^o SlSeo-cL^rf c SefinitionrSuch as MPE04 or HPE07) is a core fundamental requirement. Tbe media objects may include . 
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InterftctLve capobllltUa, but these should not nmndBte a driver's ettention Je.g. to play a media selection or to complete an 
advertised purchase), in order to experience these nulttroedia objects independent of the broadcast schedule (i.e. as on-demand 
or tiiM shifted media), there ie no retjuirenent fior roal-time presentation. 

5 DAB systems are distinguished in that they are one-way. point to multi-point transmission systems. These systems have an 

Inherent, fundatnental advantage over point to point tranmnisBioo systems (e.g. wireless internet syatena) by allowing » ainsje 
bmdcBst trreach an unlimited number o£ receivers at no incremental bandwidth cost. DAB aystens also exhibit unxque data loss 
eharacterietics (e.g.* data loss when obstacles block reaction). 

10 The CMtl* language ie designed to meet the following criteria t 

1. The language definition is open, flexible, extensible and able to represent complex object relationships. 

2. A rich set of presentation capabilities is available to media authors. 

3. The authored media is suitable for distribution over wireless DAB systems to mobile devices. 

15 4. The presentation of CAML media is efficient and intaroporable on low-powar. portable consumer devices. 

5. TO obtain optimal advantage of dab systems. Caml object distribution needs to be resilient to (some degree of) ^ta loss. 

6. It is suitable to define both program contents and electronic program guides {the penultimate metadata for broadcast audio -or 
video- services) 

20 To achieve these criteria, the authors observed a similarity between the criteria for CAML and to Internet otreaming me^ 

technologies such as RealServer and Real Player by RealNetworks, Inc. and Windows Media server and Player by "Jf^soCt, Inc. For 
st^e^ni audiorthese Internet technologies are audio- centric. They may incorporate other media as 

el^^s T noted difference is that Internet streaming media allows a server to choose alternative comptessioa streams based 
oaT^e dynamic performance of the Internet connection to each client. With DAB systems, there is «" . °f . ^ fJ^J^f^^ 
25 f nerfornancBl 0^3 oer client basis . An additional distinction is the desire to enable consumer navxgatxon capability over the 

aSdio-^ric objac?! 5tet is Sniumers should be able to follow audio-centric document relationships using single navoga^onal 
tnteriSSS JSicS do Aot «quir; S2™ cLes such as underlined or color-based textual linJcases requiring a mouse or Iceyboard 
centric interface. 

30 ab h Btartlno oolnt the authors chose the synchronized Multimedia Integration Language (smL) 2.0 specif icatlon. Thus, CAHl. 

containa a Sheet of tSe sSiL J 0 featurea i^luding basic layout, linking, media objeot^structure and timing modules. «id a 
set of CAML unique extensionB that enable rich navigation and semantic linking between media segments. 

1.2. Introduction 
35 This section is informative. 

The design of wireless digital audio broadcast systems has traditionally focused on delivering high-fidelity real-time audio to 
consumers in mobile and stationary environments. Bxanples of such systems are: 

40 ? the satellite digital audio radio system (BUARS) developed by X« Satellite Radio 
? the SDARS developed by Sirius Satellite Radio ^ 

(dS) to mobile, portable and fixed receivers. BN 300 401 vi.3.2 {commonly known as Bureka-147) 

The command Audio Markup Language was defined to provide a uniform standard- based definition which extends these «y«»^«»f ^^o allmj 
iSviSSTStoJ^Sliw JddUiSJ!? Saier, but still audio-centric, media for time-shifted presentation. Such aervxees are termed 
SS3^^ S^terStlS ISSlo ^Ja) .™i«». aHe CAML language serves as a standard representation ^^l^^^^^^^^ 

50 5;s:sM^ssnt^^^^^^ s^srs2.Si?s-5r2SSt:?r^^^ ssSht-^^^^ " 

2S;e--- T^^'i^^^i^^^-T^^-^^^ :i-^;-o^^^ss-ii.e^ 

over the same or different channels as the concent providers. 

55 

CAML content providers may present their programs on a wide variety of clients, such «s 0™-enabled digital J^^o f oadcast 

navigation and semantic linking between audio-centric media segments, 
application specific features. 

deli^ISon^fJr a Program Guide. Where practical, we have chosen to adopt several of these features s« pert of the CAML 
definition. 

Ti. «h««ifl be noted that the CAML definitions. SMIL definitions and TV-Anytime definitions, per se, make no statement regarding 

sSrS Sins ^.^-^..-^^ -=^Ni«p"^)=?xp^.o?^^^^^ 



For information and specif icatione regarding TV-Anywhere_the ^^^^^^l^tlA^'ll'lZL^.^^ 



por iSSSSS :S SiS^lcItl™ 1^1.^1 ;;iL*^he r^aS^-r Is r^ie^red to ht tp. //www*. w3 .org/^/REx:-smil/ 20ao /SMIL. 0/ . 
That a player is CAML conformant means that it can play documents at least as complex as those allowed by the CAML language 
95 definition. 

mis document is expected to expand in future version to incorporate meta information describing consumer metadata such as usage 
hSLSTttser prefeiences. and transactional isedia layers for interacting with 3-way backchanncls . 

100 

3. Design Rationale 
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Thio oection La inCoxmatlvo. 

CMtt language may be supported by a wide variety o£ ODIA-enabled players running on multiple hardware platforms. Mobile and 
portable devices share some conmon diaracterietics i 

ICD display, display can render only texts in a b«»11 area (Cor exsnvle a radio with tw linea of twelve characters each) . 

SijiVle input n»tJlodi input devices may be functional, arrw keys, and a select key. Another may have a voice interpreter. 
Audic-esntrici The primary interaction with players is audio only. THat is, no textual or graphical viewing is required to 
interact witb the object rendering. 
The CAML language aims to meet these requirements. 

l'^^^^ c«aiets of ona or a»re content items, represented in CAML language constructions. ^J^Si^^^rSaef S«2 

SrSSiS^T^SLt navigational capablUtiea of ODIA content. At the ijr'LjJtlSSrSf 'S^lS S Ba^ iJofSJ SSSSieSjf 
SMIL TOdule iaan XML subtree which, taken separately, fully conforms to the definition of a SMIL 2.0 Basic protaae oocume ^ 

LJ;u?"™^tee presentation of objects on the display device. Layout directives in wi" be *Cined «»^?^f» J^^J" 
(Sn^AppeSSTA) ThS SMIL Basici-ayout Module is used and the sure complex functionality of the other layout modules, such as 
hierarchical layout regions, is not supported. 

J'^* '^«T.*2J™t*^^4r.« » u«Bi: would likclv uso radio-like dials to select the target that activates playback or linking. A 
Ibe restrictiena are* 

Begin or end conditions are not allowed. 
Non-root time cootoiaers are not supported. 

attributes Bupport the be.ic ti-ing tPr » .l««nt. Tindng ""rlbut. ~PPort . Bynchr«,l«tioo-ba..d ti«.Un.. Si-pl. 

ev^t cLlng lo usSol and is usually easy to rawocC. and so i8 Induflea In CWH.. 

Th, pl.y« »houW an.lya. -Itch element aynte- corrertly even « it «»u.,t recogni.e the t..t .ttribut..' v.lu... 
a. 7. Accessibility 

«« dc=a«nt, .A=«».l».llity F«.tu«B of wn." tHXI-SIHL-»CC«Sl . «mn«rl... their recommendation, or. th. SMIL 1.0 WtOLll . 

3. Definition of the CAML Language 
This section ia normative. 

i-i;«^°SSSSSrtfi"S;<=r«in3 a«L Docoment. ±t It adheres to th. specificatic. described in this document inclndin, C«0. UTO 
and alBOt 

T Tfce root element of the document is a caml element. 

, Contom. to the -Bxtm-ibl. «.n»p Wna«.3. «»«t) l.O" (XWAOJ .ad '«^n^ in XW.- .p.ciflc.tion.. th. doeu«nt i. well- 

formed . 

, A nust declare a default n^nespace tor its .l«-nt. «ith it. »ln. .ttrihut. .t the o«.l root .l»«nt. A ««. docu«ent 

is identified with http» //www. tobedetermined URI. 

Por exaniplet 

<eaml aoians-"httpt//www. tobedetermlned"> 
</caml> 

skTS :SiiSce-'^s^i^'i?is;.^^ii: ^^^"^ " 

» docuneat n«y al.o identify Itself a. - vrtld eMO. »0. ao».«.t «ith . a>C»™ declaration, .Ithou,!. a OML do«-ent «..t still 

include the above CAML namespace identifier. 

The CAML language tX>CTYPB isi 

<JD0CTYP8 caml 

PUBLIC "-//W3C//I>TD SMII* 2.0 Basic//BH« 
httpi//www.tobedetermined/CAML.dtd > 

This DOCTYPB declares a valid, exteoaion-free, CAML document. 

The rules above will be updated once an XML Schema for CAML language is available. 
Confomtns CAML Players 

The CM* Pleyer is . progr» that can parse end process a am, document ^ render the content, of the d.cu-»t onto «. output 
medium. 

■me following criteria apply to "Conforming CAML Players- . 

fl» playsr must confoxm to functionality criteria defined in each «oc»,le in ways consistent with this profile specification. 
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Hie ployer ehould support the semantica oC all CAMi. language features. .The player ignores unknovm elenents under support of skip- 
content attributes. The player ignores unJcnown attributes. 

foe an attriljute with an unknown attribute value, the player subatitubes the default attribute value If any. or igaorea tbe 
5 attribute if tbe attribute has no default value. 
2.2* CAHii Language 

The OWL language supports the lightweight multimedia features defined in the SMII. 2.0 specif Icatloa. It includea the following 
SHZL 2.0 Modules ( 

10 SNZI. a.O Layout Modules -- BaBicZ.ayout 

SHIb 3.0 Liziklng Kodules -- BasicLinking 

SMZIt 2.0 Media Object Hodules Baaicnedia and ifediaClipping 
8MII* 2.0 Structure Module — Structure 

SNZL a.O Timing and syncbronisatioa Nodules -- BasicznlineTiiring, 
15 SyncbaseTiming, BventTimixtg, HinNaxTining, and BasicTimeContainers 

8MZL 3.0 Content control Modules — BasicContentOsntxol and 
SkipCootentControl* ^ 

20 Iheee collections ofi elementc are used in the following seotions defining the CAML content model t 

Colleetion Name Slements in Collection 

XiinkARClsor a, area (anchor) 

Hediacontent Text. img. audio, video, re£. animation, teactabzeam 
25 schedule Par, seq 

Collections of attributes used in the tables below axe defined as follows t 

Collection Name Attributes in Collection 
30 Core Id. class, title 

Timing Begin, dur. end, repeatCount, repeotOur, nin. 
Max 

35 Description Abstract, author, copyright 

Test ^teooitrate(systero-bitrate) , systemCaptiona (system- captions) .syateirtLBnguage (system- language) . 

SystenOverdubOrSubtitle (systein-ovBrdub- or- caption) , 

6ysteinRequired( system- required) , BystemScreenSise (systew-SBxeen-sise) , 
40 systeraScreenDepthtsystein-screen-depth) , systemAudioDesc, 
SyetemOperatingSystem, systeraCPU, systemOonsponent 

45 5^ SeferS^^^rspecial constructs that enable the CRML document to t^/Pf^jS P^"^ » '^^^ ^ 

Bpecifying the starting offset and sise of the part being referred. «» goal of introducing this construct. is to 'table a CAML 
ol^er t^Quickly locate binary data for media playback without having to scan large eictents of binary data m search £ox 
SSifio bSindar^ nSk«a It is recommended, therifore. that all binary data pertaining to a single CAMI. docuinent be combined 
S?o one bSSS^h^^t accci^ianies this document (although CAML allows to refer to wore than one banary chunk using the 

50 chunks' IDs) . 

The specific tnechanisn of transferring binary data and associating binary chuhks with CTML documents is 

however? any coS^nant CAML player n^st be ibis to parse CAML data references and be able to locate tbe specifxed fragment of 
data In tbe binary Chunk (s) which acoonvany the current CRML «k)cument. 
55 3.3.1. CAML Data Reference Attributes ^ ^ ^ , 

A CAML data reference consists of a number of attributes as defined belows 

^ name of the binary chunk. The value of src is normally equal to 'caml:thls-, thus referring to the data chunK attached to the 
60 ^r^rcSL dScuS^ Other values of this attribute with -caml:' prefix refer tc binary chunks access I W 

docui»St7AlBO. this attribute can contain any other valid URl which is processed according to the SMIL specification ISHILai . 

An exBUjple of a media object element with a arc attribute using CAML data reference! 
65 <audio id-'S- Brc-«caml.this- caml .of f sat- "1067914" camlt length- "S3 360- caml. channels-"!" camltsanplerate^-aoOO" 

cair.ltbit8perBeunple»"i6» caral » codec type- "PCM" /> 

Ldio'li^^fc^ist^'of^lockB Which differ by the audio campreseion method used. Audio blocks are represented by <audlo> 
70 Blcmenta and grouped together uoing<oeq> elements corresponding to audio layers. 

Along with the attributes described in the SMIL specification, the audio elements may have the folloifing CAML-specific 
attributes t 

75 id 

A unique identifier of the block in the CAML document 



80 



90 



Tte^startiSo offset of the block, in bytes, relative to the start of the CAML binary chunk. 
Itie length of tbe block in bytes. 



85 caml (playtime 

Ihe length of the block in milliseconda 



cainl I channels 

Itie number of audio channels in the block* e.g. 1 for mono, 3 for stereo audio, 
caml • eanplerate 

The nunber of samples per second in the audio block. 



caml t bitq>ersaii^e 
95 The auiDber of bits per sample in the audio block. 

camltcodectype 

The compression type of the audio block. Possible values are. 

100 the example of an audio layer with block information > 
cseq title«>"Bl-l.wav*> 
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«audio ld-"9« ore-'CBwl.thio" caml.ofeflBt-»X067914* eaml* length- •53360" eamlt channels."!- ca]iatsaiaplMrat:e«-44iO0" 
JS^5i*«":cSSt;5^*'S:n^" caml.l«,gth-53360- caml.channelo-.l- cana.Ba««»lerate-800D. 

CBiilibltspersB>ipleB"16** camlt codec type* "OoUyy* 
</aea> 

the top layer of a CAW, document providing means for navigating aerosa «dia aegments (SMIL n«dule8> . 



10 Blenents Attributes content Model 

Canl Core, XlBn, canl -length « dialect (content- iten+) 



Ooatant-ltem Core. I18n, typo, contentid, explration-ti«e. editlon-tiroe. anaounce-tine 

segment cSrr?«n, next etory, prev.atory, next_prin«aega«nt . prcvjprimeacspcnt. <io>«-l-2j' up^level. flrat. laat. level. 
aaBoTcontentJd. ci£_type7 EPa_title. status jnaak, avaUabilityjpronpt. prooipt.alias Smil 

?irc;J*'L^t*inSe root element of a CAML document. It contains content-item elements and has the following attrll«tcs. 
catnl -length 

Length of the CANI* document La bytes. 

Sie^lSatifier of a CAML dialect used in thia content ite». a.g. •Eurefcal47- . (reserved for future use) 
cJStent type. e.fl. •prograwT, -EPG- or •systemjCMronpts* . 

SS^f ID of the content item Identifying the program In the content database. 

SSi'^enSt'^ontent la considered expired, in the fonnat •MM/DD/VWY HH:MM,SS«. 

^Se^Sen^Se content item was last edited. In the fonaat -MM/dd/ytyy hH;MM:33- . 

45 ?SnS:;'tS: content ite» is to be available for transndBalon, in the format ;wm/OD/YYYY HH:mm:5S-. 
3.4.3. Tho eegmenb eleinont ^ - 

The attributes ot the segment: elamenc axe dettned as foumai 



^^SS'-of the Id attrllmte of a -esn-t el«nent on. lorel d<»» fro. the current Begi««t in . ™.lti-l.T.l prcgxam. 

^S^™ie Of the id attrihute of a-^t on. up from the current segment in a nulti-level progx-.. nU. attribute 

wight be redundant (tbd) . 

5SrvaS?'of the id attribute of the first Begruent element in the previous story of the program. 

60 ^vaSrof the id attribute of the first segment elen«nt in the nejct story of the program. 

Sr^i;r:f"?SS'id attribute of the previous segment ele-ent in .he current story, or. if It Is th- first ss^t of the story, 
it is equivalent to prev_story. 

^^Sr^'id attribute of the n«* ae^-nt ele.«nt in th. ».rr».t story, or. if it is the last se9»eot of the .tory, it is 
equivalent to next^story. 

?li'5alue of thia attribute la equal to -yea- If it Is the first segment of a story. 
iSS'^valua of this attribute is equal to •yea* If It Is the last segment of a story. 

^«VBl ^ ^ , .. ft .loniintfl bfilonalnQ to the first level of a multi-level program, and It Is 

The value of this attribute is equal to 0 for se^nenb elemsats oexongutg » 
equal to 1 for segrnent elements belonging to the second level. 

"^ere!r^Vf'nont«t'u^ of type -EPCT has additional attributes: 
SS?c5Sf SV?opic/progra« associated with the content of the segment. 



95 



100 



conte^t^clasB type, which can have the following values i 
? Program 



90 ? SyBtenuproit^t 

? Tra£flc_bulletln 
7 Newa^buTletin 
7 Emergency bulletin 
? undefined 



11S;-S?Snlnfl specialised rendering of the EPO item associated with the segment. Possible values are. 

7 disable_aave 

? lnvi8lble_oii_epg 

avallabillty_pronpt 
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R«f«ranc« to tha syBtBtn availability prompt (id of tha sagasnt containing tho prompt in *systea provpts* program) 
3.4.3.2. The segnazit element ot Syatem Pronpt program ^ „ * u 

The segnent elenent of a content ite» cf type 'oyatemjpronpts* has two attributes in addition to attributes connon to alX content 
item I 

5 

pronqpt alias 

An alias name of tbe system pxaapt associated with tbe segment. 
as80c_content Id 

to Contentld oC a pronpt associated with the content of the segment. 
4. X CAML docianent exanple 

The structure shown on this diagram ia implemented ixi the following CM!I» document* 

<?xml version- "1. 0" encoding- "ua- as cii" ?> , , i, 

- <caml ▼erBion-U-12" xjnlnstcana»''hctpi/ /www. conmandaucilo. com/ carol- dlalecto" navigator" caml- length-" 5444" > 

- <cwiteaS-item type- "program" title-*TestCaseS« content id- « 99 9 9 9" expiration-tinie.-06/30/2003 00.00.00- edit ion- time- -07/23/2001 
33i43i22" announca-tlme-" 07/23/20 01 23i43»22»'> . ^ - - 

- <8egmeat id="3- next„story-»17» next_i)rime9egnieat-"17" dowa.level--?- level--0» UBt--yes» firBt-*yea-» 

- <amil xinlna-»'httpi//www.w3.org/TR/RBC-mnil"> 

- «body> 

- <par> 

- <seq title«.''hi_l.txt"> 

<t:ext id-w^" flrc-"cainl i this" camliof f8et-"0" camlilengtha^ia?" /» 
</8eq> 

30 ' *a^io^iS°6-^«^-IlJa.thiB- caml.of«8et--ia7- ceml .length- -assioaO" caiQ. channels-- 2- caml.Baniple»te-M4ioo- 
cainl:bitsper8anple-"l6» caml»codectype-»PCM" /> 

</8eq9' 
</par> 
«/body> 
35 «/Bmll> 

</Begaient> 

- <:segraent id=-7- next_Btory=i''17" nejet_jorimesegnent-"ll" level- "l" firGt-*yeB"> 

- csmil 3anlns=»"bttp»//www.w3.org/TR/REC-sml'»> 

- <body> 
40 - <pax> 

- *aeq titleo"dl_l.txt"». 

<tcxt id-^a- Brc--camlitbiB» camliof foet-"ie9ll«7" cBnlileiigth»"l79" /> 

c/seq> 

45 ■ <aSio^iS-iS~iiS-canl.thia« caoa. off set-- 1891326- caml* length- 2281372- cainl. channels- 2- caml.Bainplerate--44ioo- 
camltbit8pex8airple>>"16" canlicodBCtype-"PCM'' /> 

</Beq> 

</par> 

«/body> 
50 </sniI> 

- «J^SS?''ld--ll- iiext_8tory--17'» nextjriine8egmBnt--l7- prevjpnBe8egiient.-7- level-1- lBBt--yeB»» 

- «Bmil »nlnBo"http»//ww»#.w3.org/TR/RBC-smll"> 

- <body> 
55 • <par> 

- <seq title-»dl_3.txt"> , , / 
<text id-^lJ" Brc="caTTa»thls" camliof £aeto"4i7269a'' caml» length*" 107" /> 
</eeq> 

60 ■ :a^o^i^-IJi-B^^?c^.thie- caml.offBet-»4172805» caml. length- 429248- caml = channels- -a- ca«l.sa«5,lerate-- 44100- 
cainl<bitspsrBBraple-"16* camltCodectype-opCH** /> 

</8eq> 

</pax> 

«t/body> 
65 </Brail> 

- ld-17. next^8tory-3l' nextjprln«8egmant-"21- prevjE,rime»eg«ent-3" prev.stoxy.-3- down.level-25- levcl-"0» 
f irBt-"'ye8"5. 

- <8mil xraln8=-http»//www.w3.org/ra/REC-srail»> 
70 - <body> 

- <par> 

- <Beq title="h2 l.txC"> , , ^ , 
<text id-»lB" Brc--conaithiB" caml»o£f aet-"4602053" oamlileagth-''76- /» 
</8eq> 

' :a«dio^JS-252-KS-cLa.this- camliof fset--4602l29« caml. length- 3073 88- caml.chax««lB-2- ca«li8an5,lexate- 44100- 
c3inlebitsperBanple-"16" camlieodectype-«PCN*' /> 

</8eq> 
</par> 
80 </body> 
</8mil> 

- :8e|SSS*'id--21. ne»t_8tpry-31- next jrimeaegment-«31- prevj»nmeseg»ent--i7- prev_story-3* down_level-2S- level-0- 
last-''yes-> 

85 • <8mil xmlnsa"http8//w*iw.w3.org/TR/RBC-Bmil"> 

- cbady> 

- epar» 

_ csea title- *h2 3.txt-> 

<b«xt id--a3" ere-" ca«a. this- cana.of feat--49a9Sl7» oamli length- "117- /> 
90 </8eq> 

■ <SSio^ld?^25?"2iS-cLia.thiB- caml.off8et-4909S34- caml.length-1493416- caal.channelB--2- caBaiBBmplerate.-44l00- 
camlibit8peraanvle«-16» ca«licodectype-'»Pai" /> 

</Beq» 
95 </par> 

</body» 

</smll> 

- :sc^f Id-2S- next^story-31- next_prin«aegmeat-31- prevjprlmesegment-3- prev^Btory-3- level--!- laBt-yes- £irst-yes-> 
100 - <Bmil xnanB--http.//www-w3-org/TR/RBC-Bmil'»» 

- «body> 



75 
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- cBeo tiCleti"di3 l.txc"» 

ctexb ld-"2fi" ^rc-«canatthl8- caiol.o«Bet-"6403050« caml i length- "88" /> 

</seq> 

^ ~ <Iudio^id!«28?"l«!-cLil.tlxiq- caml.of««A-"64P3138- cmil.length-MiBWao- cand. channel.- -2- caad .sawplerate-Maioo- 
caiTa ibltspersan:5)lea*"16" camljCpaectype-'PCM" /> 
</Beq»> 
«/par> 
10 </body» 

c/Btttil> 

- 'iS^f id--31- ncxtj)riiw«e3«tent--3S- pr.vj.riB».«gmeiit.-17« prov.iitory-«I7« dtei<n.levBl-"39- l«vel--0- «ir8t-«ye««> 



20 



65 
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csmll xnans»*httpi//www,w3.orB/W/»EC-«Dil"> 
15 - <body> 

- <par> 

«text id-^sa- ere- •camli this" caadioeeeet-* 1078 9618- camli length- "105" /> 
</seg> 

■ <M2io*ia!"J""'«S-«na.thl8- caniliof£Bet--l0789733- caiil.length--«80336- camli channels- -2 • canil.8a.5»ler»tB--«ioo* 
caiBltbitBper8aii»le«"l6'' eainlicod«etype-r"PCM" /> 

e/par> 
25 </body> 
</8mil> 

. <iI^?Id--35- prevjrltae8eg«8nt--3i- prev^86ory.-l7- doi«i„level--39- level-o- lasto-yee-* 

- tfsmll 3anlns-''httpi//www.w3 .ozg/TO/IlBC-Bndl«> 
30 - <body> 

- <par> 

" ^text^l^"36-^8rc^caml»tiite- caiBlio£ffiet--ll280359* caiiailengt:li--i47" /> 
</8eq> 

■ <"3io*S:"32^8;c!««nl,t:hlB" can.l.offflet--ll280406« caTHliIengtha "355572- ca™i:(*annel8.-2- caia.8ampler8te-M4lOO" 
canaibit8pei:o«nple--l6'« cainlicodectype»"PCM'' /> 

</8eq> 
«/par> 
40 </body» 
</BTail> 

- :se5SS''Id-«39« next^ritneBegment--43« prevj)rin«3eg«iit-l7- prev^8tory.-17- X«vel--1- fir8t--ye8-> 

- <5mil 3anliis-"http!//www .w3.ox^/TR/RBC-o™il'•9' 
45 - <body> 

- <par> 

*text Id-MO" Brc«"camltthla- caialtoCe8et="llG3597B" camli length- "S3" /> 
</seq> 

camXsbitBpersaniple-'ie" cana»codectype«"P(M* /> 
</seq> 
</pax> 
55 </body» 
</8mil> 

- «S[Sb^id-»43- prev^rin»8egiii«it-"39" prev_etory*» 17» l8vel-"l» laBt--yeo«> 

- <8mil 3tnanB-*httpi//www.w3.oxg/TR/RBC-snil"> 
60 - <bod/» 

- <pax> 

' <tStMdi"44^MC-"CB^iltthio" caml.ofiCset-" 14439087" caml .length- "239" /> 
</Beg> 

eamlibit8perBaiiiple«*''lfi" camlieodectype«»"PCM" /> 
</Beq> 
</par> 
70 </body> 
</Binil> 
</Bag;iBent> 
</otmtent- lteni> 
c/caml> 



5. CAUL Language Doctunent Type pefinibion (DID) 
This section is normative - 



80 <i- 

<I-- CAML DTD — BO — 
<!-- filei caml.dtd 



HjIb is Cooniand Audio Markup Language (CMIL) 

Copyright 2001 Command Audio Corporaticm. All RlghtB Reserved. 



inplied warranty. 



Author I CAC . 
Revlsioni 9Idt caml.dtd.v 0.1 3000/11/10 ll*16t4€ Bxp $ 

Pleasa use this forotal public identifier to identify thle DTD. 

*-//CoaBiBndAudio//DTD CMIL//BN'' 
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<|— Pirst w« include tha necasaary SHZX. modules. 
cnMXi auppox^e the lightweight nuLtiaeOla 
Ceatures defindd in 6H1L language. This profile includes 
the following SHZL noAileBt 

5 

6NIL 3.0 BaaicLayout Module 
6MI& 3.0 BBSicLlnklng Module 

SMIL 2.0 BasicMedia and MediaClipping Modules 
SHIL 2.0 stnxccuxe nodule 
10 SMIL 3.0 Basic inlinriming. SyncbaaBTiming . BventTlming, 

MinMaxTiming and BoelcTimeContainers Moduloa 
SHZL 2.0 BaBicContentOcntrol and SkipOoutentControl nodules 

— > 

15 <!BllTlTr % US. prefixed ■IGNORE" > 

<IBHTITY % SMIL. prefix " > 

Define the Content Hodel 

<IENTITY % sroil -model. mod ^,,r^,„ 

20 PUBLIC "-//WSCZ/BNTITIBS SMIL 2.0 Document Model l.C/ZEN" 
"Btni 1- model •! -mod" > 

«l— Nodular Pramework Module 

KlBNTiry % Bmil-frameviorX, module "INCLUDE* > 
25 < i [% Bmil - f ranwswork .moduXe ; [ 

<1E»JTI'IT % Btnil- framework. mod 

PUBLIC "-//WSCZ/EOTITIES SMIL 3.0 Modular pramework 1.0//EH" 
"emil-fraTOework-l.mod" > 
*BmH~ framework. mod; 1 ] > 

30 

<iE]3TITY % layout -mod 

PUBLIC "-//W3C//BLBHEST8 SMIL 2.0 Layout//BH" 
"8MIL-layDut.iiiod»> 
%layoub-nodf 

*IEIJTITY % link-mod 

PUBLIC "-//W3C//BLEMHITS SMIL 2.0 binking//Btl" 
"SHIL- link. mod* > 
%liak-inodr 

40 <iEiHTlXTf » BaslcLlnkingModule ''IHCLUDB»> 

clBBTITY % medio -mod j j»«„ 

PUBLIC •-//W3C//BLEMENTS SMIL 2.0 Media CJbjects/yEM" 
"SMIL-nedia .mod"> 
45 %n8 Ola-mod; 

<IBOTITY % Btruct-mod ^ «^ ..y/tni> 

POTLIC "-//W3C//ELEMEirrs SMIL 3.0 Document StructureZ/BN" 
•SMIL-Btruct .mod*» 
50 * struct -raodf 

< I ERTITY % tining-inod 

PUBLIC ■-//W3C//BLKMEWrS SMIL 2.0 TindngZ/BB" 
• SMIL- timing . mod" > 
55 %tiiiin9-nodj 

<iBnTITY % control-mod 

PUBLIC •-//W3C//KLBMSNTS SMIL 2 . 0 Content //ED" 
■ SMIL- control .mod" > 
60 tcontrol-mod; 



35 



<i-ilow we define the CAML elejaenta— > 

65 <IBLBMENT caml (content- item*) > 
<»ArrLIST caml %core .attrib; 

%X18n.attrib; 

caml -length CDATA BRBQUIBBD 

dialect CDftTA ttRBQUIRBD 



70 



^^tent-it^^' "^"^:oS"^iir„^^?^rSSUtid. expiration-ti«e, edition-ti^B. announce-tima 
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< I ELEMENT content -item { segment ■»-) > 
<\KTTL1BT content -item 
%Coz8.aCti:il>; 

%IlSn.attrib; 
type 

eontentid 

prime* segment* count 
expiration- time 
edition-tims 
onsounce-tiine 



CDATA 
aSATA 
CDATA 
CDATA 
CDATA 

auvxA 



^REQUIRED 
SKEQUIRED 
iREQUIREO 
ttRBQUIRBD 
#a SOUI BgD 
ttRBQUIRED 



95 



100 



(snU)> 

„ %Core.attrib/ 

%IlBn-attrib; 

up level IDRKF SIHPLIED 

down level IDREP ftlMPLIED 

prev~story IDRBP ^IMPLIED 

next^Btory IDREF « IMPLIED 

nextjirimeaegment IDRBF tfiMPLiBD 
prev_priiBeBegmcnt IDRBP # IMPLIED 
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firot 'yoe' fflMFLIBD 

last »ye8' BIMPHED 

* level CDATA f^IMPZiZBD 

aasoc concent id 2DREF ttrNPtiiBD 
df^type " CVATA SIMBIilED 

BPO_tltle CDATA ttZMPLlBD 

statUB^mask CDATA «inPLlEQ 

availability.; roBVfe caATA « IMPLIED 
pronpt alias cdata 9ZKVblED 



<!-end of CAML DTD «—-—-— —————— —————— —-———» 

An 3CML Sdhena Cor CANZ* will be made available, 
i^pendlx A 

14. SHKI. a.O Basic I*anguage Profile 

Oopyright 2000 World Wide Web Ocmeortium (MawachuBettB Institute of Teehnolcgy. Institut Hational de Recherche en Infonaatique 
et en Automatlque, Keio univeroity. All Righte Reserved. bttpiZ/ww-wS-org/TR/smiiao/Bwil-basichtTil 

Bditors 

Kenicbi Kubota (fctibakensisl.mei. co.jp). Panasonic 
Aaron Cohen (aaron.ra.cehenvintel.com) . Intel 

^i^'sMSTrBaBlc language profile defines a profile that is a baseline eubaet of the SMIL 2.0 language P"«Ji« "P^^^^S^^""' 
m^l io S««ian«d to bel profile that meets the needs of ceaource- constrained devices euch as mobile phones and portable disc 
SJyi«^"t^taL.S^a bSseUne III oTI^l SMIL 2.0 featurea Including basic layout, linking, media object, structure, and timing 
inodules. 

14.2. Introduction 

Si%^cSionit^';S;^«rxntegxatlon Language (SMIL, pronounced -smile-, Includca powerful ^J^f^^S; '^J.^S'^J;^^^ 
seSvlSs TOt oSy on SSfctops but also for information appliances. The SMIL 2.0 Basic language psoClle should serve such a 
ubiquitous network as a baseline for audio-visual presentations. 

SMIL content autboxa inay deoire their worke to be available on a -idespread variety of web clj^to such J|«^f ?' "^f ^"^"'^ 

-^^ifjf ^^aSfirtLo-aSr^^ ^i-iL"^?r;wSVoiiK2 ^v^^ri^^irir^^^^^^ 

«^^Sf the f Sll^iriangSge profile. L addition to providing the »eana to integrate SHU. functionalxty anto other 
languages . 

The SMIL Basic language profile consists of a small nuitiber of modules chosen from the complete ^i.fJ'J' llTttli 
- 4«« r« o£ aenantiics and syntax, and assures eonCoznance to the larger SMIL language profile specification. A proflie 

?o^ p^aSle^cM CW b?S5i»red based on the SMIL Basic language profile with or without extensions to support 

application specific features. 

compliant. Thus SMIL authoring for low power devices ie easier since general tools can be used. 

14.3. Design Rationale 

Stt SSc™.iS»iSl''SSfiI^'tB a lenauage proJile that la SHII. Hoat Language cou£or<nant aiul may >==J'"PP°«=a "^Jj^^f*"'^ °' 
SIli: plUv^niJS^thosa running on iwll <»oblle phonaa. Mobile and portabl. device, ahare 80i» oo^non chaiacueriatica. 

I SSiaW-iS^lfn^o^ i:rcL'"rba^r.i/SSa.'^w l^^r^l^lT^o^ a pointing =u««. »»t.« 

n^tiSa'^i^d'^rEawuree. for calculation i« linatad by priority ordar of aacB taa*. So. in a S-H. playar, tB. u»i of 

^^.'-./^ll^lll i^etrS^r^a^LTni :f..Z^i^Tl^rll.Tr^?.r.^l awa .« «*.c.d a. .»oh a. poaaibXa. 
fo=r ?SJ^r?S^a/«rtl^ ^c?':5,i24~'^SSS?ncr?ilToSU ^jccaa- ,«0BI«-«,:DB, iaauea gulaallna. for HTHI. content. .n« 
"XHTML Basic" IXHTOL-BASICJ provides a ndninaim subset for portabUlty and conformance. 

SS« cSl^Je^ iu^cttSnallty of th^ other layout modules, such as hierarchical layout regions, xs not aupported. 

14 . 3 . a . user interface 

- _ ... . a . M« >aK'4aar>t-o anr4 Anr>VinT-fl . and select the tar9__ 

is a 



On a SMIL Baaic olayer window, a uaer would likely use arrow keys to move focus on objects and anchors, and aelect the target 
ILI aS^v^es pliySck or^Aklng. A -mouse-likei pointing cursor device mi^t not be supported. A -move focus aelect- is 
iSSSlS StSrS^S for communication with the SMlTplayer. Ifce -mouse-click- user action can be mapped to an .activate" 

action. While a user is handling the focus, the player may slow or pause its tlmelxne. 

iS;^s2;L'"^S;Sg*^2d'SSSS^«J^ Modules present *«amic and interactive multimedia according to a '^i-^^^f ' 

Is exSr^oaeS in^ sJSSctured language .*^flis timeline of SMIL Basic presentation may need to be processed wxth Umxted memory 
Sd pro?eSSr«BOurces of mobile devlcei. For example, recursive function calls cauecd by nesting elcmenta and nemory 
allocation for additional timelines should be restricted. 

TO achieve this, the SMIL Basic language profile has restrictions on use of the SMIL Timing. The restrictions are: 
SmS^SbuS Values only^low s^li bSgin and end conditions. Lists of begin or end conditions are not allowed. 

a« In addition, the SMIL Basic profile may need to have no concept of a time container except a root time ^^"^ainer . A time 

mL±a oblBCCS into a basic unit within a local time space, and this may increase the procesaing complexxty of 

SiSSL^S«S?SSv?ci SSabilltias the document incliides time containera, the nesting depth of time containers may need 
lo 22^te5?SSo^r^y Se requ^reS to lUt^ number of chacactera or elements. THe SYKM forking Group requests feedback 
from users of SMIL Basic on these points. 

. hh^ basic tlmlBa for an element. Timing attribute values support a synchronlr at Ion- based timeline. 

S3cS^i5SS»^iUSrt S^iSt vSS.:".^«a^. llSr^Ud.- to .t.rt pr..a»t.tion. Thi. kind of .l»plo event timing la 
useful and is usually easy to support, and so is included in SMIL Basic profile. 

14.3.4. Media Object 
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10 



The BaalcMedla Hodule efpeci€lea the locabion of tha nadia that conatitute the conteato of the presentation. Here we aaauine the 
presentaeloa to be an BUdio/visiaal nultifoedla prcBcatation compoaed of reedia aucb as text, images, audio and video. 

* 3 • S • Content ContcoX 

The SMIL Basic profile includes the BaaicContentControl Modiae. For the sake of authoring consletency, a SMii. document should be 
able to contain eeveral presentation Cor different kinds of clients, controlled by switch elecnonte and test attributea. A client 
application may not need to direccly support content control oiechaniBms, since the content control proceosing of the document may 
be dona on the way to the client, when SMIL Basic is used in this way. the player may be thought o£ as the system composed of the 
conbination of the server and the client. 

Test attributea off the BaaicContentControl Modulo are included in the SMIL Basic language profile, oven when an alternative to 
the CC/PP roechanlBm is necessary. The player sbould analyse switch element syntax correctly even if it cannot recognise the test 
attributes . 

15 Sooe functionality of the Content Control Modules may be extended with CC/PP (CC/PPl oechanlsma. which provide a way to notify 
device capabilities and user prefetencee to an origin server and/or intermediaries such aa a gateway or proxy. This allows the 
generatioii or selection of device- tailored contents. Thus CC/PP can he used with transfornation of available documenta between 
client and server- 

Ttee^ire^Sseful^giidelineB to handling accessibility issues that can be applied to the profile design for information 
S^ia^M The dtocument. "Accessibility Features of BMIL- tKM-SHIL-ACCESSK sunnarises their recommendations on the SMIL 1.0 

[SMILl] 

25 14.3.7. use Of the SMIL Basic language profile ^ ^..k-m- 

SMIL Basic language profile is designed to be appropriate for small information appliances like mobile phones and portable disc 
players, ito^imple design is intended to serve as a baseline profile for application specific extensions. Similar to the 
XHTML+SMIL language profile, an hTML+SWIL mobile profile could be written that ia an integration of SHXI. Basic timing and media 
functionality into the HTML mobile profile. 

The SMIL Basic .language profile doea not restrict extension and inclusion of other modules, for exan^le. the Animation. 
MeLlnfor™l?ion,^ansitlon. or additional Timing end Bynchronisation Modules. A language may suppoirt additwnal features and 
modules and still be conformant with the SMIL Basic language profile. 
14,4. Definition of the SMIL 2.0 Baslo Language Profile 
35 This section is normative. 

14.4.1. Conformance Criteria 
Confozming SNIL 3.0 Basic Documents 

A SMIL a.O Basic document is a «Cbnforming SMIL a.O Basic Document- If it adheres to the specification described in this document 
40 including SMIL 2.0 Basic OTO and alsoi 

The root element of the document is a smil elenetnt . . , , ^ ^ 

™fS™ ?o^e "ixtensible Markup Language (XML) l.0« tXMLlOJ specification, the document is well-foxmed. 

45 A document must declare a default nasKspace for its elements with its xmlns attribute at the smil root element. The SMIL 3.0 
SaalTTSSuSSeprnSe document is idenSfied with ".http.//www. w3.org/TR/RBC.smll/a000/SHIL20/Basic" URI. For example. 
<snil xinlns=»httpi//www.w3 .org/TR/iU!C-smil/2000/SMiL20/Ba8ic''> 

50 ;i^i*inoaules that are not specifically included in the SMIL 2.0 Basic language profile, they mast be identified as being from 
the 8HXL 2.0 namespace. 

For exaovlsr a SMIL 2.0 Basic document extended to use the brush element from the SMIL 2.0 BrushNedia Modules 
<8nil xmlna»-http»//www.w3 .oj:g/TR/RBC-3mil/3000/SMlL20/Baaic- 
55 xmlns 1 8mil2a "http i //www . w3 .org/TR/RBC-Bmil/2000/SMILZ0/ •> 

<smil2 thrush color-'red" begin.nos" dura''20s"/> 
</Bmil> 

60 A document may additionally identify itself as a valid SMIL XML document with a SMIL DOCTYPB declaration, although a SMIL 2.0 
Basic document must still include the above SMIL 2.0 Basic namespace ideatafier. 

The BMIIj 2.0 Basic language profile DOCTYPE ie» 
<IDOCTYPE SMIL ^ 
65 PUBLIC "-//MICZ/DTD SMIL 2.0 Basic//Bll'» 

™i. »oc«« 2;(in:-rOSif4rJ^e;S?Si^?JU^'^TS'Lf^^ «» «!« above wlXl «P«.t«, o.ee » x«. ,chc.» 

SMIL 2.0 Basic language profile ia available. 

70 Conforming SMIL a.O Baslo players 

A SMIL 2.0 Basic player is a program that can parse and process a SMIL 2.0 Basic document and reader the contents of the document 
onto an output medium. 
75 The following criteria apply to a "ConCoxmiag 6MXL a.O Basic Players' i 

7 The player must parse a SMIL Basic document and evaluate its wall-formedneGa conformant to the XMLl.O Recommendation fXMLlOl . 
7 The player must conform to functionality criteria defined in each module in ways consistent with this profile specification. 
? The player sbould support the semantics of all SMIL 2.0 Basic language profile features. 
T The player ignores unknown elements under support of skip-content attribiites. 
85 ? The player ignores unknown attributes. 

7 Por an attribute with an unknown attribute value, the player eubstltutee the default attribute value if any, or ignores the 



80 



90 



attribute if the attribute has no default value. 



iS;'^iL^;'5 2;2iS"«eiSrp«f™"i^P«t- lightweight «aatimedia features defined in the SMIL 2.0 specification. Tlxl^ 



language profile includes the following SMIL 2.0 Modules i 
7 SMIL 2,0 Layout Nodules -- BaaicLayout* 
7 SMIL 2.0 Linking Modules BosicLlnklng* 
95 7 SMIL 2.0 Media Object Modules BaeicMedia* and MediaClipping 

; 1:1 ?SSSrSd"^Sr;;;iraSon"So^les - Baslcinllnerlming*. syncbaseTiming* . BventTiming. MinMaxriming. . and 

'"MIL^^O^ConteS^Control Modules -- BaaicContentControl* and SkipContentOintroL* 

100 i*J - reouired nodules in order to be SMIL Host Langusge Conformant. . ^ ^ . , 

4^8^ SSwS^^of elSents are used in the fiollowing sections defining the SMIL 2.0 Basic profile's content model. 
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Cblleccian Fame ElemsntB in Collection 

LinkAnchor a. axea(axachox) 

MediaContent text, img, audio, video, ro£, animation, taxtBtxeam 
5 Schedule par. seq 

EMPTY 

CbUeccions of attributes used in the tables below are defined as follows i 

10 Cbllection Name Attributes in collection 
core id, claos. title 

Timing begin, dux. end, repeat (deprecated) . repoatcount, repeatcur. mln. max 
Description abstract, author, oopfyright 

15 Ttest ^^tt^trate(8yBtein-bitrate). sya tewCapt ions (system- captions ) . Ey9tcTnI^guage{sy8teo-language). 

tvatemOverdubOrSubtitletDyetcm-ovcrduto-or-caption) , 8yBte«Required(8yot«r,-required) , 6yoteinficreenS«e(8yBten.-8creen-»i«e) . 
systetnScteenDepthCBystem-Bcreen-depth). BystemAudicDesc, systemOperatingsystem. systemCPU. systeinConiponent 
14 . 4 .3 . Layout Modules 

20 The layout Module provides a fraiaework Cor spatial layout of visual components. The SMIL 2.0 Basic profile includes the SMIL 2.0 
BasicLayout Modulo. This profile requires layout type of "text /end! -basic-layout". 

Elements Attributes Content Model 

" ZTJ. S«: llln. &ou^«<S^SiuS?cS:rL height. «i<^. bottc. tU. X«rt. right, t<*, *»«.c*g=o»«. 

EMPTY _, « . 

root-layout Core, Il8n, bacJcgroundOolor (background-color) , height, width bmpit 

region. 



35 



40 



60 



65 



iSe*Lt;^fi^''S^sLibc. th= hypcrli^X relationshlpo between content. SMIL 2.0 Basic profile includes the 8MII. 3.0 

BasicLinking Module. 

— jeM-sStr^trcS^-i-ttJ^^^^ 

^sii^-niiaSfi-^ttS^r «Si»rt i^^-^ ^..i^^r^x^^-^ ;ssJc»te .tt.i.Ste u 

ignored, see their dcfinitiona for detail, 
the ele-«.t ».d eho deprecated »ob.> »l«»nt ~r not need to be .«pp»rted U the device doee not h«. ». approprlet. e.«r 

45 tatein^? TSla> case tbe SMII. B«.lo pll^er .houXd play the presentation without the er.a m.p. 

BXopent. «^">5J;; .hS?'S5rSSUt.te, deettaattonPlaystate. sourceLevel, deatinatlonLevel. .ctesslcey. tablnde*. 

50 ^Sic^?"™"' Il.nrS:^^Jt. ccora.. hxer, show. Bourcea.y.t.te, de.tl«ati,nPl„8t.te. ««re«-«l. 

dfistinatiooLevsl, aoceeskey. tabindex, target, external EMPTY 

14.4.5. Media Object Modules 

l^H^.^l^tl^^o. anloaS^?°tJ:SSe».. re£ Core ,xa„ Deecrlptlon, Tl-1«9. «.t, .r=, xeaion. .IXX. -Xt. 

XoSgdescT type, illpBegin (cXip-beglnl . elipEnd(clip-ead) area(anchor) 

EXementa of the BasicMedla Module have attrlbutee deBorl»>ln3 haelc timing properties of content.. For tl»lng. the begin and end 

attributes should have one attribute value for a single timeline. 

14.4.6. Structure Module 

«.= St««ure Module dc-crlhce the etructure of the mm. *,c»«nt. •»» 9..I. >.0 Ba-lo profile inoludee the SMlt a.O Otructor. 

Kodule. 

«>e structure element body 1. in,.Xlcltly defined to b. a «>q cl» container .6 In the »•» »--8"9- P""l~. 

70 this is true in SMIL 2.0 Basic profile aa well. 

Elements Attributes Content Model 

emil core, I18a ( headT, body? ) 

75 Toly clll: mi \ sSSSSe' l^iJt^h 1 MediaContent 1 LinkAnchor )• 

14.4.7. Timing and syn^ronisation Modules 

The Tinar.3 ^ Synchroniratlon Modules P'JS'ImL'JTSSc ^StrtScSdSiTtS? SJi^'liSitSJ^trSf Sa'^Sr^rkSSg and 
ffiil»«»~SS:.'tSrxr,;iSrS^".~^ synSbssexl^ng. ^ontTl-lng. «u. 

BasiOTiinaContaiJiers nodules. 

«the SVMM Worlclng group ^^'^ i^^ft.^'^,ZAU'^l^^\T^lf H^'^ai^.l ^'top- 

525Sl'=SnSlS^rtSS Sri?SSS-Sitr£iiul?n^ri:%SlS;'SolSS:i^^^ too restrictive to author., we would 

iSe 4SS^^i«riiile«ntero what Uoltatlone on conpleidty are aeeeesary. 

'-hJS5:iriSS.?roiSh?pl!%ivs^^^^ '^^^^-^'^^ — 

SdirSject Se«Sts and should not have other time container elements neBted inside them. 
SSeSS,lh2^p"«ceS repeat attribute, the repeatcount and repeatDur attributes are available. 
ml^lU^^Tlo -activate" user action to select a focused element in a SMIL Basic player. 
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A8 Cor the snih Timins Moduiea for the SMIL 2.0 Baoio, there ie only one ot tribute valwe in begin and end attribute., not a 
semicolon-separated list, in order to create a single flat tinelino. 

Sle»ents J^ribuces ^^^^p^^f^,"^^^^ ( svitch | MediaContent 1 Schedule | LioWVnchor 

ilq Core, I18n. Description. Tbst. Timing. Cill. region i switch | wediacontenc | Schedule | Unkftnchor )• 

The default value of the endsyxic attribute is "last- . The default value of the fill attribute depends on the element type as 
described in the SMIL Timing Kodulee. 

14.4.8. Content Control Modules 

The content Control Module provides a framework for selecting content, Tne Smil 2.0 Basic profile includes the SM31. 2.0 
Basiecontentcontrol and skipContentoontrol Modules. aHe skip-content attribute whxch default value is "^rw", appliM to SMIL 
2.0 elements that were not a part of smu, i.e. and to elements that it was applied to in SMIL l.o, and to elements currently 
empty in SMIL 2.0 but could be made non-eiqoty in the future, following the definition in tha trodule. 

A SMIL Basic player must process the syntax of a switch element correctly even if the player could not evaluate the Test 
attribute iS e media object element properly as the attribute impliea. Test attributes that cannot be evaluated will default to 
false. 



Kleioents Attributes content Model ^ ^ , , , u* x 

Bwitch Core, IlBn { < LinWVachor ) MediaConteat )* | Schedule* | layout* ) 

14.4.9. XML Namespace Declartiona 

XML Namespace declarations using the acnlns attribute are siroorted on all elements in the SMIL Basic language profile. 
14,5. SMIL 2.0 Basic Language Profile Document Type Definition (DTO) 

This section la normative. ^ ^ ^ . ^^^^.^ 

The SMIL 2,0 Basic language profile DTD is defined as a set of SMIL 3.0 modules integrated. 

<J— SMIL Basic Document Module Module«a=>=— — * 
«1 — file I smilbaBic-modal-l.mod 

Thie is SMIL 2.0 Basic, a proper aubaet of SMIL 2.0. 
Copyright 2000 W3C <MIT, INRIA, Keio) , All Rights Reserved. 

This DTD module is identified by the PUBLIC and SYSTEM identifiers i 

pxjBLic n-z/wsc// ENTITIES SMIL 2,0 Basic Document Model 1.0//HJ* 
SYSTEM "smilbasic -model -1. rood* 

Author. Kcnichi Kubota, Warner ten Kate, Jacao van Ossenbruggen 

Eevlslon> $ldj siiiilbasic-raodel-l.iaod,v 1.27 2000/09/21 03sl0:02 Wcubota Exp $ 



rMa file defines the SMIL 2.0 Basic Document Model. ^j-m.., ^.•l4«.4»*i. 

SSl attribuSrSd intent models are defined in the second half of this file. We first start with sone utility definitions. 
These are mainly used to siii5»lify the use of modules in the second part of the file. 

- - > 

<1— — "-»o...... Otlli Body - Media w»«=»o»oB»»--«««««=o"no»oB»=B= — > 

<IE»nTy % media-object -text) img) audio) video) aniwationlbextatraamlrof:^ 

<l— ..„••....••••.••— Utili Body - Content Control -™— 

< I ENTITY * content- control "switch"* 

<l— •Besaa««M«««BBooBca utll I Body - Linking --> 

< I ENTITY % Basiclilnfc "a) anchor) area" > * 
cISHTITY % link ••%BasieLink; "> 



4 1-. — . 



The actual content modal and attribute definitions for each modulesection follow below. 



Ttmlng =" 



<IENTITY % Baa icInlineTiming. module ''INCLUDE"> 
clBMTITY % MinMaxTiming .module iIMCLUDB"* 

< J ENTITY % syncbaseTimtng. module ''IliCLUDB"> 
<IB2ITITy « BventTining .module " IHCLUDB" > 

< I ENTITY % BaBiCTlmeCoatalaers -module "lMCWn)B'»> 

<l [%BasicInlineTiming.module; [ 

<IEKTITY » basicTlmeContalners *'par)Beg*'> 

<lE«TITy % timeOontainer ••%ba8ic«'imeContainers#"> 

<! ENTITY % baalcTimeCOntainars. concent ... 

» (%media-objset; ) %eontBnt -control / |»llnk; jtbaaicTimeCon tamer a,)* "> 
< I ENTITY % tineoontalner .concent •%baBiorimeContalners. content 
<! ENTITY % baaicInlineTiming.attrib •'%BasiclnllnBTiming.attrib; "> 
<1 ENTITY % basicTlmeContalners .Bttrib "tBaaiCTlmeContainers.Bttribf •> 

11> 

ciBNTiTY i tlmeContalner *""> 

< I ENTITY t tlmeContalner .content 
<IBNTITY % basicInlixieTimlng 
<tBNnTY t basitfrlmeContainerB.attrib 

<l [%ninMaXTiiniag*modulef [ 

clENTTPy % minMaxTiming.attrlb "IrWinHajcTimlng.attrlb/"* 

1]> 

«:IEirrnY t nlnMaaCTiming.attrib 
«1 ENTITY t smil-tine.attrib " 
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tbaBieXnlimTlnlos . atbrib r 
%nliiMaatTimlns • sttrib; 
%FiLL.attribr 



IBMTITr % tiraaContainer.stbrib *• 
%baBlelnllneTlnlng .attrlbi 
tbaBLoTimsContalners . at t r lb ; 
tminMaa^iming . actrib; 

» 

IBHTIT? % par.conteni: "«tiineC3ontaiaer*contentr"> 
IBBTlTr % 8eq>eont«nb ■%tlmeOontainer.confcenfcr''a» 

lEUnrr % par.atbrlb " 
ttimsOontainer.attribr 
tSystem.attrib) 

> 

lEBTZTX * eeq.attrlb " 
ttinwConbainar.attrib; 
tsyscem.atcribi 

"> 

<IEinxiT * BasicContentControl .module "INCLUDE"* 
^lEHTITY * SfcipContent control. module "INCLUDB"* 

<lEaaTITY » switch . content 
" { (titedia-object/ 1 %linlc; )* | (ttimeContainex? ) ♦ |layout) "> 



ooacoaw- ■»»»"«»■•»'»- LayOUt —■«•-■-«»»•»»«"■•"•••■■'•"' 

«IBNTITY % Booiclayout -module "INCLU0B"> 

< I ENTITY % layout. content • (root -layout?, (region) •) "> 

<t ENTITY * region. content " EMPTY" > 

<lBiiTiTY % root layout, content "EMPTY" > 

<lBin'ITY % region. attrib "%skipContent .attrib; "> 

<IEBTITY * rootlayout.attrib ''%8]cipCoatent .attrib;"> 



clBUTITY % LinkingAttributes. module '>INCLTn3E''> 
< I ENTITY % BaeicLinJting. module "INCXUDB"> 

<tENTITY % a. content » (%media-object/ > 

<!BHTIW * area. content " EMPTY" > 
<l ENTITY % ancAior.contttAt "EMPTY*' > 

<IEMTITY % a.attrlb -%Bmil-tinie.attrib/»> 

<IBB1TITY % area.attctb ''%sinil- tine. att rib, %BXipContent.attrib;-> 
kIEHTITY % anchor .attrib "%»inil- time. att rib; %BkipContent.attrib;"> 

a«»«»»B»«M»>'>*«>» Media 



«IEMTrrY % BasicMedia. module "1KCMJDB»> 
clBMTlTY % MediftClipping. module "INCLOTB"* 

<} ENTITY % media-object. content • (area (anchor) 
clEUrrrY % media-object. attrib " 

% smil - time . attrib, 

tsystem.attrib; 

%lleglon .attrib; 

*> 

<l_- structure ' 

<lENTrry % smil. content " (head?, body?) 
<IBNTITY % bead- layout -content "layout] switch" > 
<IBHTITY % head, content • (*head -layout, con tent,-) T"> 
<IEHTITY * body. content " (ttimecontainer; |*inedla-obDect» | 
%content-oontrol, l%llnkr)*"> 

— End o£ Bmllbasie-model-l.iiiod' — «-»»~™»— « 



< 1 - - 

<!-- SHIX* 2.0 Basic DTD B»»MB««»«io»«»«iaB 
<l-. file I SMIUOBasic.dtd 

This is SMIL 2.0 Basic, a proper subset of Wii. 2.0. 

copyright 20Q0 HorW Hide Hab Ccnaorti*. tittssaclmsett. In.tlt«tB of Wclmoloar, in.elt»t H.tton.X a. R..^rcl» » Intti-atlque 
et en »utoi»tl<iao, K«lo Univaniey. »11 Bis?*« Beoorvsd. 

copyright holders make 

no representation about the sultabiUty of the DTD for any purpose. 

It is provided "as is" without expressed or in5>lied warranty. 
Author I Jaoco van ossenbruggen, Kentchi icubota 

Ro>rision. $Id» SMIL20Ba8ic. dtd. v 1.3 2000/09/21 11,16.46 jvanoss Exp $ 

<J-- This Is the driver file for the ewili Basic OTO. 

Please use this formal pubUe identifier to identify itt 
II.//W3C//DTD SMIL 2.0 Basic//BM" 

— > 

<IB!3TrTy % N8 .prefixed "IGNORE" > 
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clBNTXTT % SMXL.preCix *" » 

c|.- Define the Content Model — » 
clBirTXTT % smll-nodel.inod 

FDBLZC ■-//H3C//BNTIT1ES SMIL 2.0 Basic Document KoOel 1.0//BH" 
oomlXbasic-inodel-l.inQd" > 



Modular Trmiework Module 

<lsmT? t Binil- framework .module "INCUIDB* > 
10 < 1 t%8inil-f racoework .module ; ( 

«IBIITIT7 % Bmil-frBsievozk.niod 

PUBLIC "-//HacZ/BwrXTIBS SMIL 2,0 Modular Fravewotlc 1.0//BN" 
"ernll- framework- l.mod* > 
«sniil- framework .mod; ) } > 

<!-- The SMIL 2.0 Basic Profile eupporto the lightweight multimedia 
features defined in SMIL language. This profile includes 
the following SMIL moduleai 

20 GMIL 3.0 BasicLayout Module 

SMIL 2.0 BasicLinking nodule 

SMIL 2.0 BasicMedia and MediaClipping ModuXOB 
SMIL 2.0 Structure Module 

SMIL 2.0 BasiclnlinTiming, SyndbaseTiming, EventTiming , 
25 MinMoxTiming and BaaicTiroeContainere Modules 

SMIL 2.0 BasicContentControl and SklpContentContcol Modules 

< I BNTrre % layout-mod , 
30 PUBLIC --//wacZ/BLEHBIITS SMIL 2.0 X»ayaut//Eir> 

•SMIL-layout .raod"> 
%layout-TDOdr 

<!EWTmf % link-mod 
35 PUBLIC "-//W3C/ /ELEMENTS SMIL 2.0 Ltllking//BN" 

« SM XL- 1 ink . tnod » > 
%link-Riod/ 

<lENTITy % BasicLinkingModule "INCLUDB"> 

40 <iBNTmf % media-mod 

PUBLIC "-//wac/ZBLBMBHTS SMIL 2.0 Media Objects/ /BT" 
"SMIL-media .nK>d"> 
%tnedia-mod| 

45 «iENTmf % Btruct-mod 

p-JBLic --//wacZ/ELEMSHTS SMIL 2.0 Document StructweZZEN" 
"SMIL-Btruct .mod"> 
%6truct-modj 

50 <IBNTTIY % timins-nod . , , 

PUBLIC "-/ZH3CZZBLBMBlirS SMIL 2.0 TamxngZ/BH" 
"SNIL-timing .mod"> 
ttiming-modf 

55 <lBNTlTr % control -mod 

PUBLIC "-//ViaCZZELEMBllTS SMIL 2.0 Coatent//BM» 

•SMIL-coatrol.mod"* 
% control -nodr 
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1 , Introduction 

30 Jhe'pS^srofl this docuiwnt la to eatabilsh functional requireiDenta and performance epecif ications for the ODA Studio 

Jhe'lS^eid^'audience for thia document ia Conanand Audio'a nanageaent. operatione, engineering and software P^°9ramming staff . 
Thia doooment will alao seinre as . baaia of agreement between the.e partiea aa to the syaten'a functionality and performance 
levels 

ihe*BcS^°of thie docwaent will include constrainta, functional requireroeota, and performance apeclf ications. 
iu5ic-Sn-St^'seJ^S^' ^St*ti:?"enablea Ustenera to cbooae the progranmdng they want to hear, whenever they want 
and wherever they are* 
40 Block zndieatea the type of coiqpreaBion in an audio layer 

CAML Cbimnnd Audio Markup i.anguase (a derivative of xml) 

SlSSt. The haalc program building block in the ODA Studio Composer. An element can be * /esn^^t^ i^r^^irati^^* 

4S CWtt heSdS element CAMI. heade? Semento allow introductory detaile of a program to be placed "P«"tely f rom ^be main atory 
^ ^taU elSSSt. CAHL detail elements allow additional content relating to header elenenta to be placed on this 

CoiDound Segment A aegment which contains more than one eegment 
Content Material fortransmission to Command Audicenabled devices. 
50 Layer Repreaenta multiple typea of media, auch as audio, text, Image or video 
Program Playsihle content made up of elements 

PrSe Segment Snialleat navigational unit, made up of one or more layers 

CA Command Audio Corporation 

55 ODA Studio on-demand Authoring Studio 

2. System Overview 

60 programs which interest them. 

•ma ODA studio is created with the express intention of creating these navigable programs. 

program, and details, the specif io stories wbioh relate to the headers. 

3. Design Oonsiderabions 

3.1. Assumptions and Dependenciea 

70 7 The ODA Studio runs on the Windows 3OO0 Operating System w4«». 4„„i.^ii«<i 

75 f SiS'SfS?2«HS'lS''S^ designed aa a coipreheneive replacement for other editing progr«» on the market, but instead is 
developed solely as a vehicle for creating Command Audio Content. 

3.2. Related Software or Hardware 

3.3. General Constraint a 

7 For aitiQnm editing, wave file size should not exceed xxMb ^ „ „„„ «„« •.i„o 

80 ? FUes^iarSitent ^lorer should be protected so that only one user ™ay change contents at any one time. 

3.4. Goals and Guidelines 

? Should easily adapt to other partners' aoftwara 

3.5. Development Methods 

85 I Z^^^ll iSs*^5eoided that the ODA Studio would operate on a Windows platform. Active X controls were chosen to distinguish the 
functional capabilities of each part of the studio. 

4. Architectural Strategies 
4.1. System Architecture 

The ODA Studio was conceived as a replacement for the current Comnand Audio editing syBtem. ENCO. One of the main benefits of 
the ODA studio is the flexibility it offers. The ODA studio includeo 4 components 1 

7 Content Explorer displays multimedia files which are used to create a program 

7 conrposer provides a visual stage to co«oaBe content. The Composer is made up of a Navigation View. Con^ression View, and 
Httltimsdia View. 

7 proinpter text content can be crested and existing text files can be opened. 

7 waveform Bditor is the place vrtiere audio file, are edited and Begn»nted into On Demand Interactive Audio. . 



90 



95 
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7 segment audio programs speciCically for Conmantl Audio-enabled receivers. 

5 

4.2. Programs which can be created in the ODA Studio 

4. a. I. Type onei . , . ^ „ _, 

A program which requires rainioial processing, way only need to be marked for conpression. It is comprised of one prime segment 
only but contains at least ona media layer. For exanple, the prims sogment could contain a music track, associated textual 
10 inforwadon about the singer and writer, and an image oC the singer. There are no navigacional elements in a prine aesnent. 
4.2.3. Type twot 

A single level program which can be linked in such a way that a liotener can navigate between different segments. Barfj of the 
segments is a prime segment capable of having several media layers. The navigation is sequential. For example, a listener can 
lie ton to story 1, skip etorlea 2 and 3, listen to story 4, and go back to hear story 2 by Gcaiming back through 3. 

A two level program which allows additional navigation options. H»o program consictG of a ooquenco of haadsrs with aesoeiatod 
detail segments. The user can now navigate from header to header or can navigate from a header to the associated detaU. instead 
of only being able to navigate between segments, a listener can navigate story headlines (headers) before deciding i£ they are 
interested in hearing the details behind the headlines. These programs allow a listener to navigate bock and forth through 

20 headers and details in the program segmeats 

The fourth^ type^of program is a type three program offering the user even more navigational captions. Ttie user can essentially 
navigate even within a header or a detail segment. The segmants are marked in such a way that the listener can navigate within 
the headers and details. 2f there are two separate thoughts in the headline, these might be marked in such a way that the 
25 listener could skip, forward, rewind within headers. Tha segments are narked in such a way that the listenar can hear/choose 
specific portions o£ the details as well. 
4.3. ODA Studio Container and ActiveX Controls 
The ODA Studio Container hosts 4 ActiveX eontrolsi 

30 ? content Explorer Control displays the content required to build the output multimedia CAMI. objects, and provides the ability to 
drag and drop these bbjects into otbar parts of the ODA Studio. Ejcaraples of this content include i audio prograina. earcons, texts. 

?°p?o^ter' Control is the ActiveX convoaeat that allows text related to a specific audio recording to be created or edited 
7 waveform Editor Control is responsible for multiple functions of editing audio files (wave files) 
35 ? composer Control provides Ennotionaliby for composing a CTJO. multimedia object frora vnltiple source conponents. 

pieaentlyy^WawfSi^Bditor Control is ivplenented within ATI. framework. It utilises OLB Drag And Drop for exchanging wave files 
with other components. It uaea DlrectSound API for accessing the system's audio resources. HFC is used for rendering waveforms 
and CUI. 

40 

7 Ability to have two playback nndes. In Mode l, cursor moves across the waveform in sync as the waveform scrolls forward, in 
Mode 2, %»ave£orm view does not scroll forward when cursor reaches right edge, but playback continues. 
4.3.X>1. Recording 

? Ability to indicate recording is in process by illuminating the record button and peek meter 
45 V Ability to pause and resume recording by selecting pause or play. 

? Ability to save wave file by using windows keyboard shortcuts or file menu 

4.3.1.2. Basic Bditing ^. ^ 

? Ability to rewind, play, stop, pause, forward, toom in and room out using butt<Bi8 on tue tooi2>ar 

i SilitJ to S l^st action Uclions to be defined later) using a button on the toolbar or a keyboard shortcut like Ctrl Z 
50 4.3.1.3. Scrolling and Selecting • 

? Ability to scroll left and scroll right using arrows on the keyboard or the mouse and scrollbar 4„/«„t 

7 Ability to eoom the wave Into at least 100th of a aecond, and soom out to view the entire waveform using the soom in/out 
buttons on toolbar. 

7 Ability to select sections of the wave using the mouae and ctrl key. . _^ . . 

55 ? Ability to adjust the selection by single pijtels from the left or right border using keyboard arrows and the shift Key 

? 'Abiiity^tr^sert/delete markers and coTi5)reo8ion blocks into imported waves by right clicking with the mouse 
? Ability to keep markers consistent even if audio between them has been removed or changed, 

60 ? "^iilcy^r^opy^d^^ st^wavc sections from the source (recording) pane to the Target pane and within the ^59^^ Pane. 

7 Abilit^ to replace sSlected portion of waveform with data from the internal clipboard at the insertion point by using Windows 
shortcuts . 

t'Jbiiity^to^teSin playback of a current selection or of the entire waveform £rom either the left edge of the waveform display or 
65 from the cursor position. 

COTtent^SjlSrerSs^baaed on a MFC CTreeView class that ain«>Ufies the usage of ths tree control CTreeCtrl. the class that 
encapsulates tree-control functionality. 

Content B^mlorer io a MFC ActiveX control. Its two objectives i -«„,-,^. -„« 

7 TO dispSy (in tree/branches format) media sources available for building the output multimedia caml objects. These sources can 
be audio programs, texts, images, oomnsreials, etc. These building blocks can be files or records in databases. 
T TO initiate a dragging mechanism when moving or copying tree items to other parts of application. 

Tte'pioSS'SctiveX control provides text content Cor CAIft objects. Prompter is a MFC ActivtsX control based on a cairtiBdityiew 
c^BBTSSSBditvnw ^Ides the fiunctioaallty of the rich edit control within the context of MFC's document view architecture. 
CRlchSditVlew maintains the text and formatting c]iaraoteri8tlo o£ text. 

SO ?"Abiiitv°tS^flIrpa"a of text for re-evaluation later in editing process. A keyboard syiribol and shortcut needs to be assigned 
to this feature so that PS can easily doublecbeck and review work. Flag will remain In prompter as long as any of these remain 

in txt. PS can place notes specific to file as well. ». ^ 

7 Ability to differentiate comment text from script text using separate color and font and brackets. Announcer needs comment text 
to indicate pronunciations and emphasized words in script. ^ « ^ , „ 

85 7 Ability to create headers and details which partaln to waveform recording by preseing Control H and Control o. 
7 Ability to adjust font sire and type using Windows keyboard shortcuts 

7 AbiUty to open content from content explorer and outside applications. . . ^ ^ ^ ^ ^ ^ ..,1 ^„ 

t AblUty to save content which has been created in prooipter, as well as content which has been imported and changed in pronpter 
using Windows keyboard shortcuts. ^ ^ ^ _^ 

90 7 Ability to scroll down through text using up and down arrows on the keyboard or a aeroUbar 

^ 3.4, Constoser 1 

Comooser control provides functionality for assembling a CAKL nuicimedia object from multiple source conponents . coo^wser cont«l 
i^acts with all other ActiveX controls. Its GUI depicts a CAMI, multimedia object con^iosed of Cami. elements. Currently a CAML 
95 element from GUI point of view is shown aa a rectangle, and can be a prime segment or a compound segment. 
4.3.4.1. Basic Features ^ ^ 

7 Segments can be inserted, deleted and or appended using the buttons on the toolbar. 



70 



100 



Nhen the nurtbar of segments reaches the edge of the CoaQKwer View, you should be able to scroll forward through the view. 
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Segnencs can be vlcsved in any order, moving back and forth or vp and down between headers and details by usix^ tbe arrow Iceys on 
the Iceyboard 

5 5. Subsyatem Architecture 
5.1. Coinposer Coniponent 

A new GUI design is iaf>leniented for 1.2 release. New Ceatxires include i 

S.l.l. single Level program presentation ^ 

10 Before creating a program, choose the type of program you wish to create. They can select a eingle level or a two- level program 

from an options raenu. and the appropriate screen will appear. To create programs which do not require conplex navigatron 

capabilitiea, choose a aingle-Xayer program. For more complex programs, two- level programs should be created. These programs 

will be segmented so that listeners will still be able to navigate between stories. 

S.l.a. UTavigation View . 
15 Piles can be dragged and dropped, inserted* deleted* attached and appended asseinbled in tbe Navigation view. Because tbey are 

parts of the overall program composition, aegnnntB. layers and blocks will all be managed within tbe navigation view. 

5.1.3. nultinedia layer view i .... a 

You can select individual multimedia layers in the multimedia viewer. A preview pane is available to examine text, image, or 

video layers. A wave layer can still be viewed in the Waveform Editor. You eon right click oo a segment to view the properties 
20 of that segment. Properties can include i 

? File name 

7 File sire 

? File length 

? Dote file was originally recorded 
25 ? Mams of parson vtdio last worked on file and when 

? Source of the original recording (satellite fro m ISDH £rom , etc.) 

? senile rate at which it was recorded. 

The con^rMsiOT^vlew^dlsp lays the blocks which represent coopxession in a wave file. The conpressioa view works with all parts 
30 of the multimedia viewer to illustrate the way the different layers fit together in a program. 

6. Skin capabilities 

6.1. User Inter faoe images (bitmaps) reqpiirements for OOA Studio 

The targeted resolution for tbe OOR Studio is 1Q24 x 768 pixels. The conpooer on tbe upper right hand side of the studio should 
35 measure 600 X 330 pixels. The user will be able to choose the type of skin from a list of available skins Th« properties of the 
SIS can be wli^ble to one component or to all of then. Skin elements must be able to be stretched without distorting original 
image. 

6.1.1. Eefjulrementa for the Composen 

1. A background image - ConOk.btnp 
40 6.1.1.1. For the Prime segmsnti 

7 Prime segment eapty selected - PrlSegBS.bqp 

? Prime segment enpty unselected- PriSegBUs.bnp 

? Prime segment full selected - PriSegPUs .biop 

7 Prime segment full unseiected - PriSegFUs.bnip, 
45 7 Detail t Prime asgaent empty selected - PrlSegBS (det) .bn^ 

7 Detail t Prime segment eropty unseiected- priSegEUs(det) .bn^ 

7 Detail ( Prime segment full selected - PriSegFUs (dot) .buip 

7 Detail: prime segnent full unseiected - PrisegFUaCdet) .bii5> 

6.1.1.3. For the Cosqsxnmd Segment • 
50 T A bitmap image that looks good when stretched. 

? Compound segment selected - ComSegS .brap (should this be OanSegBS.bmp) 

7 Conpound segment unseiected- coraSegUa .bn^p 

? compound segment full selected - comsegps . bmp 

7 Corapoiind segment full uneolocted - CanSe<^U.bmp _ 
55 7 Detail: Compound segment selected - OcmSegS (det) .bwp (ComSegBS.bwp) 

7 Detail t Conipound segment unseiected- ComSegUs(det) .bnqp 

? Detail: Compound aegwent full selected - CoaiScgPe{det) .bin> 
. ? Detail: Compound segment full unseiected - ComSegPUtdet) .bop 

7 PrijTOO segment onqpty sslectod - PriSegBS.bcnp 
60 7 Prime segment eitpty unseiected- priSegEU8.bmp 

7 Prime segment full selected - PriSegEUs .bcnp 

T prime segment full unseiected - PrlSegFUs .bn5> 

6.1.1.3. TOolBar bitmap with an image for the following functionsi (ConrroolBar.bmpj 
7 Append 

65 7 Attach File 

7 Delete 

7 Insert Before 

7 Insert AEter 

7 Assemble 
70 ? Player 

6.1.1.4. Icons for Multimedia layer vlewi 
7 icons need to be 16 x 16 pixels in sise. 

I Blt^l^l^'il J^iS of . .l,n in th. tr« vl«. of th. layer vim.. Tb. tr« i*o«, the l.yere In tbe e.,M«t) 
73 ? Opened segnent ConiLaySeg0.bmp 
7 Closed segment- CoraLay8egC.bnq> 

7 Pox wave file- ComL^Hav.bnqp 
7 For Text rile - ComLayTxt .hep 
80 T For Image file - ConOiaylmg.fcnv 
7 For Video File - ComLayVid.bmp 
7 For Animation - ComLayAni . bno) 
7 For Conpreasion viewi 

85 I ?:'x5;»l!iSrSt«S^r?!Sp^S.ion. lU. Ovai »d ooxar in tb. c^,«.ion vi«, «. ^.a t«<. ■»« bitmap, -hich win look acoi 
when resisedi 

7 TO represent DVSI - ConCojiipDVSI.bmp 
7 To represent DOLBY - ComCor^jDOli.biiqi 

90 Requirements for the Content BKploren 

Background Image - conBJc.brt?) 
7 Icon for the main repository 

7 icons need to be 16 x 16 pixels in size. « «n 

The following subf older icons (We can either have a separate icon for each folder or a uaifoim icon for all folders) . 



95 



7 If we have only one icon for all folders t 
7 Con Fol C.bmp 
7 con Fol O.brap 



too 7 If we have separate icons for eac^ type of folder t 
? Audio Clips - CanPolAud.bmp 
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T Earcone - conFolEar .btnp 
? Music sanplea- ConFolKus .famp 
? Prompt files- ConPolPro.boip 
7 Video £iles • ConPolVld.bnip 
5 r Text Files- ConPolTjct .btt© 

? Image Files- ConFollntg.binp 
? Wave Filas-ConNav.bnip 
? Text FileaHTon TXt.bop 
? Music Files-Con Mus.bnp 
10 ? Aninotion Files-Con Avi.bnp 
? Image Files^KTon Iing.bmp 

Ttie icons created for Multimedia layer view can be uoed to denote each file In the Content Baqplorer also. 

e.a.l. RequirenentB Ear Have 8ditor> 
15 Bitmap for toolbar of target pane - HavVoolborTrg.btqp* with the Collowing buttons 

7 Rewind 

7 Play 

? Stop . 

7 Pause 
20 7 Fast forvrard 

? Zoom in 

T EOOTS Out 

? Scroll left 
7 Scroll right 

Bitmap for toolbar of target pane - WavToolbarSxc.bnqp, with the £ollowiag buttons 
7 Rewind 
7 Play 
7 Stop 
30 7 Pause 
7 Record 
7 past forward 
7 zoom in 
? zoom Oat 
35 7 Scroll left 
7 Scroll right 

Bitmap for navigating handle - WavSavHdl.bmp 
40 t. Detailed System Design 

rihe^'SSitalSSi^oS^iStea with a control using a set of COM interfaces. Two-way connmmication ia performed through connection 

f^^^iat^SllSi^'S^t^f JSs aSien?"^pertie8, which allow the container to provide inf oxrration to its controls. ^liB ensures 
45 a uniform loSk and feel for all the Controls visible inaido the Container. The Controls are supposed to react to the change of 
the ambient properties and ^chronize the appearance and behavior with the other controls accordingly. 

7 flie ODA StSdS controls hSe propertiea whiS affect the behavior o£ a control. They can also be used to pass data to and from 

J*«xroS**Studio Controla also support stock properties, which «e standard propertiea llXe Font end Color . f wdard^pertiea 
50 are also known to the Container and therefore can be bound. Specifically. Control can inform Contaxner that a stock property la 
about to change and allows the container to reject the change. ^ ^ ^ , . ^ la ruBtartad it will 

? Control's Properties aro persistent so that information is retained when control is closed. When control is restarted, it will 
default to the settings used when last closed. 

7 The ODA Studio Controls are required to respond to ambient property changes 
55 7.3. waveform Editor 

7.2.1. interfaces 

Currently Wavefoni Editor Control exposes one interface - 
IffaveBditObj with five methods* 



60 



SetW«vePath(BSTR bstrPath) , When a wave file ie selected, the variable betrPath passes the name of the wave file to the 



Waveform Bditor. 
Playt)i Comnumda Waveform Editor to play loaded wave file. 

StopPlayC)» Commands waveform Editor to stop playing loaded wave file. „»r4«hi« onCount 

batrPath. 

7.2.2. Ambient Property Handling 

On Btartap the control calls CComControl' s methods t 
70 GetArtbieatBackColor. GetAna>iBntPoreColor,OetAmbientPont to set up stock properties. 
Ilhen an and>ient property ehangeo, the Container calls 

on H.«f-m. ,dI?S'SSnii'SSS^rS?IpS"fSSr;iip«ty that ha, ch».9ed. The control override, this ^t^. obtain, property 
value and handles the change. 
75 7.2.3, Ctestom Properties ^ . ^ 

For setting up custom properties a prt^rty page is required, 
initialising properties 
Persisting properties 

7.2.4. Drawing 

80 Synchronous scrolling is implemented to display a playing wavefiom. 
Current rendering rate is 10 panes per second. 

7.2.5. User interaction 

l^lc^ l^:l'l:^Ts.TT.\.o editing panes. Xn the target pane extra -"'^^i^J^- 
85 can also be marked for scanning and compression purpoeea. In the lower t source) pane, sound can be recorded tnrougn a maxer ror 
inclusion into the wave file in the target pane. 

-^j-L^. rpS: »::?r^risssjnrcr.i»"iitSS.%TtS^^^^^^^ ^> - isis: ^.u 

pane for inclusion into an eicistiag wave file loaded there <not implemented yet). 
95 The target and the oource panes are eeparated by a splitter, which allowa the pane windows to be re-aised. 

Ja^fo?; E^J^MrMve control buttons: -go to start-, -play-, -pause- (not implemented,, 'stop-, 'go to eacT . «8. -record- 
button is absent in the target pane. 
100 The target pane also has four control buttons: -room in", -worn ouf. -scroll backT. and -scroll forward- . Scrolling is also 
possible with a borisontal scroll bar at the top of the pane. 
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The pane hae horizontal nilore to njeaeure the playback time up to a 100th of a second. The rulers change scale with window 
resizing and ectoII in sync with playbadc. 
7.2.S.3. Setting Markers 

A navigation handle indicates the current position in the wove file. Handle can be moved back or forward with the mouse. Sound 
will be played when handle is moved using mouse (scrubbing). 

Karkers can be set to define coo^resslon bloclcs. Mazkers have the following attributes 1 compression (Dolby, dvsi. skip). The 
marker attributes ace indicated in a dialog window. Segment markers have labels to indicate conpression choice. Markers can 
subsequently be removed by double clicking on segment marker and pressing "Remove narfcer* button. 

Portions o£ the wove file can be selected by holdiztg the Ctrl key down while dragslng the loft mouse button. Geleotione are 
draggable outside of the control. 

The Context taenu appears when right mouse button la clidced. Menu options include setting segment marker at current mouse 
position, selection cut, copy and paste (not Inplementad) . 
7.3- Contf^t Kacplorer Control 

7.3.1. Drag and Drop Mechanism ^ . ^ - ^ 

Content Bj^lorer ia?>lcn«:nta a KPC OLB drag-and-drop tnechanlom. When a user tranofcro data, uoing either the Clipboard or drag and 
drop, the data has a source and a destination. Content Explorer provides the data for copying and another part of application (it 
can be Conposer or Waveform sditor) accepts it for pasting. The MFC provides two olasses that represent each side of this 
transfer! 

Data source (as inpleraented by COleDataSource dbject) r^resents the source side of the data transfer. It is created by the 
Content Bicplorer when data is to be copied to the Clipboard, or when data is provided for a drag-and-drop operation. 



Data abject (as inplemented by COleDataObject object) represents the destination aide of the data transfer. It la created tihen 
the destination ActiveX has data dropped into it, or when it is asked to perform a paste operation from the Clipboard. 

Currently a well-kno%m CP^HDROV Connat is used for dragging and dropping files. 

7.3.2. User Interaction 

Content Explorer displays all folders and files that reside in the directory called Repoaitozy. A user can drag a tree Item and 
drop it onto a layer, segment, tree view or waveform editor. Teict files can be dragged fila Into Presqpter. 

7.4. Pronipter Control 

7.4.1. Xnterfaees * 

The Pxon^ter ActiveX control has just one _DProjn?ter interface. 

To get a pointer to this interface 1 
CConPtr< DProaipter> pObj ; 

pPraapterCtrl->(^ieryInterf ace ( uuidof (^DPronpter) , (LPVOID * } &pC& j ) r 

pcb j • >FooMe thod ( ) 7 

Here pProqpterCtrl of type LPOLEOBiTECT is a pointer to the Pron^ter ActiveX control . 

The ^DPron^iter Interface haa the following methods: 

void'OnFileOpenText ( } ; 

void OnFlleSaveTextO / 

void onPilesaveTextAs ( ) t 

BSTR GetDocumentPathO ; 

BSTR GetContentO r 

BOOL iBModifiedO ; 

7.4.3. User Interaction 

A User can do the following chinga: 

7 Open the toxt fila from Fiio manu and select the *Open Prompter Text* menu xtem. 
? OR, place cursor in Prompter and begin conq>oeing text* 

7 T«t ca^ be'^divided into headero and details. To insert a header marker, a user tmiat press Ctrl and H keys at the eame time. To 
insert a detail marker, a user mast press Ctrl and D keys at the same time. Pron5>ter automatically numbers headers and details 
aequontially. For example, if the lost header io «Headar> 5, pressing Ctrl and H keys puts <Beader> 6 into the cursor position. 
7 save the text using one of the following j save As, Save Pronipter Text, or Save Prowpter Text As, from the File menu. 

7.5. Composer 

current ly*^the°CoSpo8er ActiveX control has just one _DConipoBer interface. The following code shows bow to get this Interface « 
CComPtr< DCotnpoBer> pObj/ 

pcomposerct rl- >Query interface ( uuidoC (.DCon^ser) , (LPVOID • ) cpObj ) 1 

pObj->PooMethod() ; ^ ^ , 

Here pConiioserCtrl is a pointer of class LPOLBOBJBCT to the CoofMser ActiveX control. 

Currently this interface haa just one nethodt 

8etPramptex({LFUllKH0tm*)6(pProRipter)) . The Composer ActiveX control has a mentoer of class ColeClientltea* njPromptor. This 

method sets DUPPrompter to the Prompter ActiveX control pointer. 

7.5.3. User Interaction 

Conposer has the following bnttonst 

Append. Appends new enpty header and detail elements to the CAML object. 

Attach. Opens a file dialog box. A user can choose a file and attach it to the selected element. ^ ^, , ^ j,i 

Mete! Sletes a selected element . in a two-level program, if a header is selected, its corresponding detail element will 
automatically be deleted as well. ^ . , ^^^^ 

Insert before. Inserts segment before the selected element, in a two- level program, an upper and lower element will be 

insert^after. inserts segment after the selected element, in a two-level program, an target and lower element will be Inserted. 
Play next. Plays next header element 

Play previous. Plays previous header. , j 

Play down. Plays the header's corresponding detail elanent when a header element is selected 
Play up. Playa the detail's corresponding header when a detail elenent is selected. 
Stop. Stops playing a selected element- 

AsBonblQ. Attaches wave aegmante from the source pane of the Waveform Bditor control to the CAML elements according to the 
prompter text layout. The first segment is assigned to the first header/detail in the prompter text, and so on. 

In addition, a user can do the following tblngot ^ a,. r.»«T «i ^ 

7 Drag a wave file from the Content Explorer control or Microsoft Windows Explorer and drop it on a CAML element or multmedia 
layer in the Composer control. 

? Drag a selected wave segment from the first pane of the waveform Edit control and drop it on a CMlL element. 
? Move a file attached to a CAML element to a n o t h e r element. 

7 Append a file attached to a CAML element to a file attached to another elenent. To do it a user has to press a Ctrl key and 
move a file at the sane time. 

8. Detailed Subsystem Deaign-D.A.V.I .D Systems 

The to^eroSd Authoring Center's Composer ActiveX (control) interacts with the Multitrack Editor (client). The Multltrack Editor 
is a client of the Composer. Cosniunication between the two ie bi-directional, the client controls the Cmqioser and vice versa, 
8.2. conqooser ActiveX 
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The Contposer Irapleinente two kinda of InterfacQSt incoming and outgoing. The incoming interface conCaina oethgtls that are called 
by Che client. The outgoing Interface is used to notify the client of the control's events. It is called a sink interface, 
because it sinks event noti£i.cation« . 
8.3. Incooiing Interface 
5 8.3.1. Description 

Control's incoaing interface is called _DOosqposer and is created by the MFC ActiveX Control wlsard. Tbe current jDC0iig)O8er 
interface has tbe following Bxstbodat 

- void BSTR GetBlockB (B5TR batrObjectlD) 
10 - void long OnDelete (BSTR bstrObjectlD) t 

- void long OnDragOrop tBSTR bstrFormat, long X, long Y, Bbort moCe. BSTR bstrobject) r 

- void onFileNew (); 

" void BSTR OnGetMetadataO r 

- void long onsetMetadata (BSTR bstrCoinposerNetadata) ; 
13 - void long SetPropezties {BSTR bstrSetPropertiea) / 

The GetBlocka (BSTR batrObjectXD) method rebnmB an XML string containing information about blodcs In the object trith a given 

object ID. 

20 The OnDelete (BSTR botrobjectlD) method ia called by the client when an object is being deleted. 

Clips from the client multi-'forraat clipboard or any txaok oan be moved to a compooor element (header or detail prime segment) . 
The OnDragOrop (.) nethod is repeatedly called by the client during drag-and-drop operations. The method has tbe following 
parameters I 

25 

- bsbrFormat represents a drag fomat vbicb la an XML string with the following structure i 

- 4c^jectin£o» 

cob j ectld>objectia</objectid> 
«dur>duratian in USc/dur> 
30 - </objectinfo» 

X and Y are tbe current mouse coordinates. Using the coordinates, tbe Cooposer can determine whether tbe nouse Is inside tbe 
particular Composer element r 

• node indicates whether drag or drop operation occurs; 
35 - bstrobject is a string representation of the dbjectid of the dragged object. 

The OnFileNew ( ) method ia called to create a new project in the Conposex. 

The Cooposer Metadata presents the etrueture and content of the program loaded is the Composer. The client calls the 
40 OnGetMetadataO method to get the Composer Metadata. Tbe return value is a string representation of the Ccoposer Metadata. So. 
the serialised project includes this string. The Metadata string is an XML string. 

The OnSetMatadaba (BBTR bstzConcsosezMetadata) method Is called by the client upon loading the project. The Composer, using 
bstrConposerMetadata, can resfcoxe the previously saved program. BstrConpoeer Metadata is an XKL string. 

SetProperties (BSTO bstreetProperties) is uaed for previewing layers selected in Multimedia I.ayer View. The parameter 
bstrPropertles is an XMZi atrlng with tbe following stmcturei 
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<otoj ectinf o^ 
50 <objectid> </objectic3» 

«dur> </dur> 
<roarkerinfo> 

<naEleer> 

<po8> </poB> * 
55 <tikle> </tltle» 

«type» </type» 

c /marker > 
</inaxkexinf o> 
«/objectlnfo> 
60 8.4. Outgoing Interface 
6*4.1. Description 

Control's outgoing Interface is called jDconposerBvents and is created by the MFC ActiveX Control Hiaard. The current 
__DConqposerSvents interface has tbe following events i 

65 - void BdibObjeot (long objeotXD, long^result) 

- void GetPropertlea (BSTR bstr PropDescr) 

- void PlayObject (long object ID. long* result) 

- void StqpPlayObject (long objectXO, long^result) 

- void SaveCurrentState(long*result) 

70 - void SaveObject (long objectID, B8TR path. long*resttlt) 

- void savesource (bstr SavesourceFatb. BSTR* bstrSaurcename) 

- void Get File (BSTR xmlObjeetlnfo, long*reault> 

The client (not the control) iraplemento all these events. The Compoeer can only fire tbe events. For exaniple, to fire SaveObject 

75 event the Compooer executes the following codei . ^ ^ . ^ . 

PireBvent(dlBptdSaveObject,BVEllT_FASAM(VTS_I4 VTS_WBSTR) . objectlD. path}. PircEvent through the COM machanxsra passes 
control to the client trtiere the corresponding method is called. 
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The bstrPropDescr parameter of the GetPropertiea event ie an XML string with the structure i 

<objectinfo> 

<objectid> </objectid> 
«/ object info 



85 The GetFile parameter ie an XML string with tbe structure; 

<objectinfo> 

<objeotid> </objectid> 

<path> </path> 
90 < format > </fonnat» 

« /object info 

8.5. Client 

a. 5.1. Description 

95 The client does the following things i ^ ^ ^ ^ 

7 itnplementa events that the Composer flrea. To do this a class of type CAdvisesink chat derlvea from .DcooposerBvents has been 



7 launches the Cottpoaer ActiveX that allows the client to create the embedded OLB item of type CSavldClientCatrZtem that derives 
100 from COleClientltem. To do this the client needs to know just the Conposer ProgZD "COMPOSER .Coc^oaerCtrl .1* 
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T defixies the Cbnposer position in the client area 
? gets a Conqposor pointer of type zconnectionpointcsontaiaer 
5 7 using the last interface Cinda the I Connect ioaPolnt interCace 
7 creates an object of type Cftdviaesinlt 

? through ICormootionPoint interface calla Adviae method that passeS the pointer to the CftdviaeSink object 
10 9. Gloseaxy 

10. Bibliography 

1. punccional requirenents 
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We Claim: 

1 . A method of editing audio or video data using a display, comprising the acts of: 

providing at plurality of segments of the audio or video data; 
displaying an icon representing each of the segments; 

associating a iRrst one of the segments with at least one other of the segments; and 

displaying an indication of the association of the first to the other of the segments thereby 
composing a program of the segments; 

wherein the program may be played in a sequence determined by a user in accordance 
with the associations. 

2. The method of Claim 1 , wherein the associations are each a hyperlink. 

3. The method of Claim 1, wherein the associations are each displayed as a spatial arrangement 
of the icons. 

4. The method of Claim 1 , wherein each icon when activated results in playing at least a portion 
of the segment represented by the icon. 

5. The method of Clakn 1 , wherein each icon carries an identifier for the segment represented by 
the icon. 
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6. The method of Claim 1, wherein each displayed icon is designated as a first type or a second 
type, a plurality of the second type being associated with each of the first type. 

7. The method of Claim 1, wherein each displayed icon is designated as a first type or a second 
type, a plurality of the second type associated with each of the first type or the second type. 

8. The method of Claim 1 , each icon representing content selected firom the group consisting of 
audio, video, image, or text. 

9. The method of Claim 6, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

10. The method of Claim 7, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

1 1. A computer system having a gr^hical user interface for editing audio or video data on a 
display, comprising: 

a memory storing a plurality of segments of audio or video data, 

a portion assigning an icon to be displayed representing each of the stored segments; 

a portion which associates a first one of the segments with at least one other of the 
segments, and displays an indication of the association; 

a composer which composes a program of a set of the associated segments; and 
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wherein the composed programs may be played in a sequence determined by a user in 
accordance with the associations. 

12. The system of Claim 1 1 , wherein the associations are each a hyperlink. 

13. The system of Claim 11, wherein the associations are each displayed as a spatial 
arrangement of the icons. 

14. The system of Claim 1 1 , wherein each icon when activated plays at least a portion of the 
segment represotited by the icon. 

15. The system of Claim 1 1 , wherein each icon carries an identifier for the segment represented 
by the icon. 

16. The system of Claim 1 1 , wherein each displayed icon is designated as a first type or a 
second type, a plurality of the second type being associated with each of the first type. 

17. The system of Claim 11, wherein each displayed icon is designated as a first type or a 
second type, a plurality of tiie second type associated with each of the first type or the second 
type. 

18. The system of Claim 1 1, each icon representing content selected fi-om the group consisting 
of audio, video, image, or text. 
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19. The system of Claim 16, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

20. The system of Claim 17, wherein the program when played by the user plays each of the 
segments represented by an icon of the first type in a predetermined order, and allows user 
selection of playing each of the segments represented by an icon of the second type. 

21. An improvement to a computer editing system, the system allowmg composition of a 
program firom a plurality of audio or video segments using a graphical user interface displaying 
an icon identifying each of the segments, comprising: 

assigning links between the segments by displaying a spatial arrangement of the icons; 

the spatial arrangement representing a link between a header segment and a detail 
segment wherein the program includes a plurality of header segments played in a 
predetemiined order and a plurality of detail segments played in an order of election of a 
user in response to an indication of each link. 
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<Header> 1 

A gift Crowe about 

<Detail> 1 

Russel Crowe is taking his rock band, 30 
Odd Foot of Grunts, to Texas tiiis summer 
for a concert celebrating the 15th birthday of 
Sydney Perry, the daughter of Texas Gov, 
Rick Perry. The Aug. 18 show at Stubb's 
BBQ in Austin will benefit the city Settlement 
Home for troubled youth and will kick off a 
brief U.S. tour by the Oscar winner's band, 
Crowe became friend^ with the governor last 
year when his band was in Austin recording 
an album and performing. 
<Header> 2 

Chelsea Clinton, dad score U2 tickets. 

<Detail> 2 

Bill Clinton and daughter Chelsea bounced 
to U2's beat at the Irish quartet's U.S. finale 
Friday night in East Rutherford, N.J. 
Arriving as the concert started under bright 
house lights, the former president shook 
hands with excited fans. U.N. Secretary 
General Kofi Annan also was spotted in the 
celebrity holding pen on the floor of the 
Continental Arena, along with Caroline 
Kennedy, model Christy Turlington and her 
fiance' actor Ed Burns and members of 
R.E.M. 
<Header> 3 

A sneak peek at Harry Potter' trailer 

<Detail> 3 

The new preview for the movie Harry Potter 
and the Sorcerer's Stone will be available 
Wednesday on AOL (keyword Harry Potter) 
I to subscribers . The trailer will 
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^<Header> 1 

If you've read the critical reaction to PBS's 
10-part documentary Jazz (concluding this 
Wednesday at 9 p.m.), you know that Ken 
Burns and his crew of commentators pay 
scant attention to the post-Coltrane era. 
^<Defa//> 1 

jh0 17'plus hour series devotes twice the 
amount of time to the four years between 
1935 and 1939 as it does to the past four 
decades and hints that in recent years the 
public lost interest in ']3Z7. and the form has 
stagnated. Some critics have attributed this 
omission to the heavy hand of "senior 
creative consultant" Wynton Marsalis, who 
heads up what might be called the neocon 
movement of jazz, which, broadly stated, 
favors returning to codified jazz traditions 
over pushing the boundaries of the form. 
^Header> 2 

Here's another, more innocuous theory. In 
Burns' series, jazz is inextricably tied to race 
and racial struggles, indeed, Burns has stated 
outright that Jazz, along with his series on 
the Civil War and baseball, is part of a trilogy 
on the theme of race in America. 
<Detail2> 

While it's relatively easy to build an early 
history of jazz around an examination of 
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